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II.  Statement  of  Research  Objectives 

The  research  objectives,  as  stated  in  the  amended  contract,  are: 

(a)  Investigate  real  language  extensions 

(b)  Develop  control  design  methodology 

(c)  Develop  asynchronous  coding 

(d)  Study  the  representation  of  states  (in  asynchronous  hybrid  systems) 

(e)  Formulate  improved  controller  design  procedures  for  synchronous 
hybrid  systems 
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III .  Status  of  the  Research  Effort 

The  objectives  of  this  phase  of  the  proposed  research  on  discrete 
control  of  continuous  processes  have  been  substantially  achieved.  This 
annual  technical  status  report  is  divided  into  two  unequal  segments,  deal¬ 
ing  with  research  at  M.I.T.  and  at  Northeastern  University.  The  second 
and  shorter  segments  constitute  the  final  report  of  the  Northeastern  Uni¬ 
versity  Subcontract,  under  the  direction  of  Professor  Kaliski;  however, 
only  4  weeks*  effort  was  budgeted  due  to  his  sabbatical  leave  of  absence. 
A.  Research  at  M.I.T, 

1.  Coder  Synthesis-  for  Synchronous  Systems 

We  have  already  motivated  our  study  of  coders  in  the  context  of 
digital  control  systems;  in  fact,  in  many  cases  the  entire  system  in  the 
feedback  loop  may  be  viewed  as  a  coder.  To  recapitulate,  we  viewed  a 
coder  simply  as  a  map 

G:  RP*  -*■  W 

where  Rp  is  the  free  monoid  generated  by  Rp  (p-dimensional  real  Euclidean 
Space)  and  W  is  an  alphabet  (a  finite  set) .  Some  examples  of  coders  are 
(memoryless)  A/D  convertors  (or  more  generally  quantizers)  and  delta  modu¬ 
lators.  In  a  more  theoretical  view  we  may  wish  to  model  our  digital  con¬ 
troller  as  a  quantizer  followed  by  a  transducer  (such  as  a  finite-state 
transducer  or  a  pushdown  transducer,  etc.)  with  the  following  implications: 
That  all  coders  may  be  decomposed  into  the  cascade  connection  of  a  memory¬ 
less  quantizer  followd  by  a  transducer,  and  that  the  most  general  coder 
may  be  represented  as  a  quantizer  in  cascade  with  a  Turing  transducer. 
Simple  counter-examples  show,  however,  that  not  all  coders  may  be  realized 
this  way.  Our  research  has  been  directed  toward  establishing  general 


canonical  realizations  for  coders. 

We  have  identified  three  basic  approaches  for  the  development  of  the 
realization  theory  which  we  loosely  terra  the  analytic,  the  algebraic  and 
the  linguistic  (or  syntatic)  approaches.  The  former  approach  involves 
obtaining  physical  realizability  constraints  for  Kaliski’s  general  coder 
decomposition  theorem  [1];  this  viewpoint  is  currently  being  pursued 
although  no  results  have  yet  been  obtained.  We  summarize  here  the  results 
of  the  last  two  approaches.  Here  we  have  begun  to  develop  a  hierarchy  of 
coders  of  increasing  complexity,  motivated  by  the  already  existing  hierarchy 
of  automata. 


The  success  of  the  algebraic  approach  hinges  on  the  definition  of 

P* 

appropriate  right-  congruence  relations  on  R  .  We  have  defined  a  gen¬ 


eralized  Nerode  equivalence  relation  =g  for  C  which  may  have  finite  index 
even  though  the  minimal  realization  of  C  is  not  finite-state.  The  relation 


D* 

=Q  is  defined  as  follows:  u  =a  v  iff  C  Q(y)  =  C,  Q(y)  for  all  yeRF  , 
u  y  u>  y  v, y 

p* 

where  the  shift-conjugate  function  C  :  Rr  +  W  is  defined  below. 


Cu  Q(y)  =  CT6(y)  yeRP  with  0  <  Z(y)  <  Z(d) 

Cu  Q(y)  =  CTU(y)  yeRP  with  2(y)  >  2.(0) 


9eR^  is  a  parameter.  Then  a  coder  is  defined  to  be  shift-finitary  if  the 

TJ* 

minimum  length  9eRK  for  which  =  has  finite  index  is  one  (with  the  impli- 

y 

cation  such  that  a  0  exists).-  Special  cases  are  as  follows: 


(i)  The  index  of  =Q  is  1;  C  is  said  to  be  shift  unitary 

y 

(ii)  =g  has  finite  index  and  the  minimum  length  of  9  is  zero;  C 


is  said  to  be  finitary 


(iii) 


=  has  unit  index  and  the  minimum  length  of  6  is  zero;  C  is 
said  to  be  unitary. 

The  most  general  coder  in  this  hierarchy,  the  shift-finitary  coder,  has  a 
minimal  hybrid  state-space  RnxQ,  where  n  =  2.(0)  and  Q  is  a  finite  set.  The 
structure  of  the  coder  is  shown  in  Figure  1.  In  the  case  of  a  shift-unitary 
coder,  the  finite-automaton  in  Figure  1  has  only  one  state.  Clearly,  the 
shift-register  of  Figure  1  is  not  present  in  the  realization  of  unitary  and 
finitary  coders;  these  coders  are  finite-state  realizable,  and  may  be 
decomposed  into  the  cascade  connection  of  a  quantizer  followed  by  a  finite- 
state  transducer. 

In  the  linguistic  or  syntatic  approach  we  view  the  coder  as  an  ac- 

P* 

ceptor  of  a  real  language  L,  which  is  a  subset  of  Rr  .  Here  we  take  W  to 
be  the  two  element  set  {0,1},  and  C  accepts  L  as  follows: 

C(y)  =  (  1  if  yeL 

(  0  otherwise 

The  most  general  grammars  that  we  have  studied  for  generating  real  languages 
are  the  real  context-free  grammars;  these  are  a  generalization  of  the  real 
context-free  grammars  of  Lemone  [2] .  We  have  generalized  the  notion  of  a 
pushdown  automaton  to  accept  real-valued  signals;  this  new  "machine"  has 
a  hybrid  control  module  (state-space  Q^xRn  for  an  alphabet)  and  a  stack 
with  a  hybrid  stack  set  Q^xR^,  with  an  alphabet.  Since  context-free 
languages  are  nondeterministic  in  general,  this  acceptor  is  also  non- 


deterministic. 

Since  the  continuous-state  part  of  this  pushdown  coder  is  infinite 
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dimensional,  the  coder  may  be  considered  unrealizable,  unless  of  course  an 
equivalent  finite-dimensional  realization  can  be  found.  In  principle  this 
can  always  be  done  (according  to  Kaliski’s  general  coder  realization  theorem 
mentioned  above),  but  in  practice  this  may  only  be  feasible  for  special 
examples.  A  subset  of  the  real  context-free  languages  are  the  "bounded  real 
embedding  "  (BRE)  context-free  languages,  where  the  acceptors  for  these 
languages  have  a  finite  stack  set.  These  languages  may  thus  be  viewed  as 
the  largest  general  class  of  real  context-free  languages  which  represent 
realizable  coders  (although  for  the  purposes  of  coding  we  should  restrict 
ourselves  to  the  deterministic  subset  of  these  languages). 

The  right- linear  real  languages*  are  a  proper  subset  of  the  deter¬ 
ministic  BRE  context-free  real  languages.  Here  there  is  no  stack  at  all 
in  the  acceptor  realization;  the  coder  is  finite  dimensional  (with  a  state- 
space  QxRn,  Q  an  alphabet;  see  Figure  2).  An  acceptor  of  a  right-linear 
real  language  is  only  finite-state  realizable  if  the  grammar  is  of  order 
one  (the  order  of  a  grammar  was  defined  by  Lemone  [2]).  In  fact  the  coders 
which  accept  languages  generated  by  first  order  grammars  are  precisely  those 
coders  referred  to  above  which  may  always  be  decomposed  into  the  cascade 
connection  of  a  memoryless  quantizer  and  an  automaton. 

The  syntactic  approach  to  coder  synthesis  has  clearly  been  illuminat- 

★ 

Productions  of  a  right- linear  real  grammar  take  the  form 
A  -*■  wB  we<f> 

or  A  -*■  B 

where  A,  B  are  nonterminals,  w  is  a  string  of  terminal  symbols  of  length 
n 

n,  and  4>c  K  is  a  replacement  set. 


.  Ufl  il 
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ing.  We  note  that  our  extension  from  finitary  to  shift-finitary  by  the 
addition  of  a  shift-register  appears  natural  in  the  context  of  right-linear 
real  languages  (any  language  describing  a  shift-finitary  acceptor  is  right- 
linear)  .  It  would  be  premature  though  to  say  that  the  natural  structure 
of  coders  are  those  corresponding  to  acceptors.  Further  developments  are 
needed  along  the  lines  of  the  analytic  approach  mentioned  above  and  an 
extension  in  the  syntatic  approach  to  more  general  phrase-structure  grammars. 

2 .  Discrete  Control  of  Synchronous  Systems 

The  design  of  a  digital  controller  for  a  continuous-state  system 
usually  involves  the  design  of  three  subsystems:  a  coder,  a  control  algo¬ 
rithm  (e.g.,  to  reside  in  a  digital  computer)  and  a  decoder.  If  the  coder 
and  decoder  are  allowed  to  be  dynamic  systems  and  the  control  algorithm 
is  modelled  as  an  automaton,  then  it  is  clear  that  the  digital  controller 
may  be  viewed  as  a  coder  connected  directly  to  a  decoder.  The  structure 
theory  we  have  developed  for  coders,  some  of  which  may  be  extended  to 
decoders,  then  provides  general  models  for  the  controller.  An  interest¬ 
ing  viewpoint  yet  to  be  fully  explored  is  to  view  the  controller  as  a 
translator  T  of  real-valued  sequences  into  real-valued  sequences 

P*  JJl* 

(T:  Rr  -*■  R  )  using  syntax-directed  schemas  [3]  to  describe  T  (these 
consist  of  pairs  of  real  grammars,  one  called  an  input-grammar  and  the 
other  called  the  output  grammar). 

In  the  case  where  the  coder  and  decoder  are  constrained  to  be  finitary, 
the  entire  controller  may  be  viewed  as  a  finitary  coder  C:  R^  -*■  W  where 
W  is  a  finite  subset  of  Rm,  the  plant  input  set.  A  finitary  controller 


may  thus  always  be  decomposed  into  the  cascade  connection  of  a  memoryless 
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quantizing  coder,  a  finite-state  transducer  and  a  memoryless  decoder,  the 
latter  being  simply  a  realization  of  a  mapping  from  the  finite  output  alpha¬ 
bet  of  the  transducer  to  W.  All  of  the  procedures  discussed  in  the  literature 
for  designing  finite-state  controllers  concentrate  on  designing  the  trans¬ 
ducer;  the  design  of  the  coder  and  decoder  are  omitted.  Also,  since  these 
schemes  involve  either  approximation  or  learning  via  ad  hoc  adaptive  algo¬ 
rithms,  the  theories  provide  no  performance  guarantees. 

We  have  developed  an  algorithm  for  designing  finitary  coders  for  a 
very  general  class  of  nonlinear  deterministic  discrete-time  systems:  those 
that  are  piecewise  continuous.  The  algorithm  provides  an  effective  procedure 
for  computing  the  coder,  transducer  and  decoder  for  the  following  problem 
formulation:  Given  the  plant  F,  find  a  finitary  feedback  controller  that 
will  drive  the  plant  state,  starting  initially  in  Xq,  to  the  target  set  Z 
in  a  finite  number  of  steps.  This  is  the  finite-horizon  problem;  in  the 
infinite  horizon  problem,  the  plant  state  is  required  to  remain  in  Z  for 
an  infinite  period  of  time  once  it  has  reached  Z.  In  both  of  these  cases 
the  regulator  initial  state  is  fixed  and  depends  on  Xq.  This  has  been 
termed  the  synchronous  control  problem  by  Gatto  and  Guardabassi  [4]  and  the 
weak  regulator  problem  by  Sontag  [SJ. 

The  controller  is  designed  in  two  steps:  First  an  aggregate  finitary 
model  of  the  plant  is  obtained,  and  second,  a  finitary  controller  is  designed 
for  this  aggregate  model.  The  aggregate  model  has  the  following  properties: 

(i)  it  is  a  nondeterministic  finite-state  system 

(ii)  the  states  of  the  model  are  in  one-to-one  correspondence  with 
the  blocks  of  a  finite  partition  P  of  the  plant  state  space  X 
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and  (iii)  the  set  of  possible  states  that  the  model  may  be  in  at  any  time 
k,  viewed  as  a  subset  of  X,  always  contains  the  actual  plant 
state  at  time  k. 

It  is  the  task  of  the  designer  to  choose  the  partition  P.  Once  this  par¬ 
tition  is  chosen,  the  aggregate  model  may  be  completely  specified.  At 
this  stage  in  the  design,  the  only  requirement  on  the  choice  of  P  is  that 
the  aggregated  sets  Xq  and  Z — specified  new  in  terms  of  blocks  of  P--still 
provide  an  acceptable  aggregate  control  problem  formulation  (e.g  P  is 
well-suited  to  the  approximation  of  Xq  and  Z) . 

The  solution  of  the  aggregate  control  problem  requires  the  design  of 
a  finite-state  controller  for  a  nondeterministic  finite-state  plant.  The 
problem  formulation  now  appears  to  have  similarities  with  the  usual  "un¬ 
known  but  bounded"  stochastic  control  problems  (see  Sira  Ramirez  [6])  and 
the  control  problems  for  deterministic  finite  automata  (Gatto  and  Guardabassi 
[4]),  although  neither  of  the  solutions  to  these  problems  are  directly 
applicable. 

Since  the  states  of  the  controller  may  be  viewed  as  state-estimates 
of  the  aggregate  model,  the  specification  of  P  also  provides  us  directly 
with  the  coder  (since  there  are  only  finitely  many  different  state 
estimates).  The  remainder  of  the  controller  is  designed  in  three  stages 
(for  the  infinite  horizon  problem) .  The  first  part  involves  the  computation 
of  all  those  state-estimates  contained  within  Z  for  which  there  exist 
control  inputs,  guaranteeing  that  future  state  estimates  have  the  same 
property.  Specification  of  these  admissable  control  inputs  defines  a 
finite  partition  on  the  plant  input  space,  once  again  because  the  set  of 


all  possible  state-estimates  is  finite,  and  this  partition  partially 
specifies  the  decoder.  The  second  part  involves  sequentially  identifying 
all  those  state  estimates  that  are  controllable  in  finite  time  to  the 
estimates  computed  already,  until  a  state-estimate  is  obtained  that  contains 
Xq.  Again,  the  admissable  control  inputs  define  a  finite  partition  on 
the  plant  input  space.  The  design  is  completed  by  selecting  from  each  of 
the  blocks  of  the  input  space  partition  (obtained  in  the  first  two  parts 
of  the  design  procedure)  a  representative  input.  This  completes  the  design 
of  the  decoder. 

The  straightforward  application  of  this  algorithm  has  the  following 
potential  disadvantages: 

(i)  A  controller  may  not  exist  for  a  particular  partition  P 

(ii)  If  P  has  a  large  number  of  blocks,  it  may  be  impractical  to 
compute  the  controller  because  it  will  have  too  many  states. 

To  keep  the  design  feasible,  the  number  of  blocks  in  P  must  be  kept  as 
small  as  possible.  However  with  coarser  partitions  it  becomes  unlikely 
that  a  controller  may  be  found.  To  overcome  this  dilemma,  we  have  develop¬ 
ed  a  hierarchical  design  procedure,  wherein  the  controller  is  computed  in 
stages.  A  two  stage  design  proceeds  as  follows  (the  extension  to  an  n- 
stage  design  is  obvious).  A  coarse  partition  is  chosen,  together  with 
a  "large"  target  set  Z^  D  Z,  and  a  controller-  is  designed  for  F,  Xq  and 
Z^,  based  on  P^.  Then,  a  refinement  of  P  ;  called  P^,  is  chosen,  and  a 
controller  is  designed  for  F,  Z^,  and  Z.  Note  that  if  at  either  stage 
no  controller  can  be  found,  it  becomes  necessary  to  try  to  finer  parti¬ 
tions  and/or  larger  target  sets.  Design  experience  with  actual  systems 
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will  clarify  what  choice  may  be  appropriate.  At  each  stage  in  the  hierar¬ 
chical  design  procedure,  the  controller  with  the  fewest*  states  is  sought 
by  choosing  the  coarsest  partition  possible.  At  each  stage  then  we  are 
dealing  with  a  nondeterministic  automaton  as  an  aggregate  model  of  the 
plant,  which  has  a  state  set  which  is  not  too  large  to  make  the  controller 
design  impractical.  Details  of  these  results  appear  in  Appendix  H. 

3.  Analysis  of  Asynchronous  Feedback  Systems 

The  most  important  phenomenon  encountered  in  asynchronous  hybrid 
systems  which  does  not  occur  in  synchronous  systems  is  sliding  mode 
behavior — "infinitely  fast"  switching  which  may  occur  along  a  discon¬ 
tinuity  in  the  state  transition  function  and  which  results  in  a  trajectory 
shape  which  could  not  occur  in  the  absence  of  the  discontinuity.  An¬ 
other  phenomenon  is  that  the  class  of  systems  which  admit  finite¬ 
dimensional  realizations  is  less  pervasive  in  practice  than  for  synchronous 
systems. 

The  problem  of  representing  sliding  mode  behavior  in  asynchronous 
hybrid  systems  arose  even  in  the  restricted  context  of  diced  systems 
(Appendix  C)  in  the  form  of  a  condition  that  the  sequence  of  switching 
times  for  such  a  system  be  "asymptotic"--i . e.  have  an  infinite  limit. 

We  have  constructed  a  counter-example  of  a  diced  system  which  is  not 
asymptotic  (included  in  the  continuation  proposal  for  this  research) . 

This  shows  that  there  are  cases  where  sliding  mode  behavior  may  achieve 
exact  equilibrium  in  finite  time;  however  there  are  other  cases  of  slid¬ 
ing  where  this  does  not  occur.  In  such  non-asymptotic  cases,  the  use 
of  switching-times  as  hybrid  state  variables  is  not  sufficient  to  fully 
characterize  the  behavior  of  a  diced  system. 
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This  paradox  implies  that  care  must  be  taken  in  developing  a 
realization  theory  for  asynchronous  (continuous-time)  hybrid  systems. 

One  possibility  is  to  consider  a  class  of  realization  which  enforces 
a  separation  of  control  and  that  flow  at  inputs  and  outputs  and  to 
place  conditions  on  the  maximum  switching  rate  of  control  signals. 

Many  problems  are  known  to  arise  when  both  control  and  dtat  are  combined 
on  a  single  channel  (e.g.  Witsenhausen's  counterexample  in  stochastic 
control).  Some  examples  of  hybrid  systems  which  arise  naturally  in 
robotics  are  given  in  Appendix  F. 

An  important  class  of  applications  which  can  be  represented  as 
asynchronous  hybrid  systems  arise  in  multitasking  systems  where  the 
tasks  involve  interaction  with  continuous  processes  (timing  processes) . 
It  has  been  shown  (Appendices  D,E)  that  under  certain  conditions  such 
systems  admit  a  synchronous  hybrid  representation.  These  conditions 
place  a  limit  on  the  number  of  tasks  (to  ensure  finite-dimensionality), 
on  the  minimum  delay  in  switching  tasks,  and  on  the  degree  of  continuity 
of  the  continuous  processes.  An  example  of  representing  a  temperature- 
control  system  in  this  manner  has  been  provided  in  Appendix  E. 


A 
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B.  Research  at  Northeastern  University 

Much  of  our  work  is  based  upon  the  key  decomposition  result  reported 
in  [  i  ] .  Specifically  we  cite  the  following  Theorem:  Let  C:  R*  -*>  [0,1] 
be  an  arbitrary  coder.  Then  for  any  n  >  1,  C  may  be  decomposed  as 
C  =  where  •  is  functional  composition.  C^:  R*  ■*  Rn  and  R°  [0,1] . 

Further  is  realizable  by  a  finite-dimensional  discrete-time  system  of 

dimension  i>  Although  such  a  result  is  primarily  only  of  theoretical 
interest  it  serves  as  a  starting  point  for  relating  properties  of  and 
to  those  of  C  and  conversely. 

1.  Well-Behaved  Coders  from  the  Input/Output  Viewpoint 

The  research  undertaken  here  sought  to  identify  and,  if  possible, 
make  rigorous,  the  notion  of  a  physically  well-behaved  coder.  This  notion 
is  an  intuitive  one,  e.g.  the  coder  defined  by 

C  (u, . .  .u,  )  =  (  0  if  u,  +  ...  +  u,  >  0  or  if  u  is  null 

cr  1  k  1  1  k  — 

(.1  otherwise 
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is  intuitively  well-behaved. 


but  the  coder  C 

B 


defined  by 


S(U1 


••v 


0  u  =  X,  the  null  string 

0  u^...^  is  a  palindrome 

1  otherwise 


is  not.  Clearly  some  implicit  notion  of  continuity  is  involved  here, 
although  we  must  be  careful  in  using  the  term  "continuity",  as  the  range 
of  the  coder  is  discrete.  We  developed  several  potential  definitions  of 
"well-behaved"  during  this  research  period  that  embody  these  concepts. 
Further  research  should  try  to  relate  these  various  definitions  to  one 
another  and  to  the  more  formal  algebraic/topological  approaches  already 
explored.  We  give  some  of  these  definitions  below 


Definition  1:  C  is  well-behaved  at  u, ...u,if  3  e  >  0,  dependent  upon 

1  K  k 

Uj...^,  such  that  if  v^.-v^  e  R*  obeys  £  ju^-v^|  _<  e  then  C(u^...u^)  = 
C(vr..vk).  1=1 


Definition  2:  C  is  strongly  well-behaved  of  order  k  1  at  u^. . .u^  if 
3  eL  >  0,  dependent  upon  both  u^.-.u^  and  L,  such  that  if  Vj.-.v^  £  R* 

obeys  £  !ui*vil  —  eL  anc*  w1*''wd  e  R*  arbitrary>  p  <_  L  then 
i=l  " 


CCUj^. .  .u^  w^ . 
at  Uj. . .u^  if 
L  >  1  and  s*  = 


.Wp)  =  C(v^. . *v^w^. . .Wp) .  We  say  C  is  strongly  well-behaved 

it  is  strongly  well-behaved  of  order  L  at  u^...u^  for  all 

min  {e. }  >  0, 

L  L 


Note  that  this  latter  concept  embodies  the  notion  that  "close  together 
strings"  (within  £*)  of  the  same  length  map  to  the  same  values  regardless 
of  what  is  appended  onto  their  ends.  The  values,  of  course,  depend  upon 
what  is  appended.  If  C  is  strongly  well-behaved  at  u^.-.u^  then  the 
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£*-neighborhood  of  consists  of  length  k  strings  that  are  Nerode 

equivalent  to  ^...u^  (as  well  as  other  strings,  possibly,  of  length  dif¬ 
ferent  from  k).  Interpreting,  correctly,  "well-behaved"  (Def.  1)  as  strong¬ 
ly  well-behaved  of  order  0,  we  see  that  each  of  these  properties  are 
successively  more  stringent. 

We  posit  two  other  difenitions  that  follow  a  somewhat  different  tack. 


Definition  3:  C  is  causally  well-behaved  of  order  e  >  0  if  whenever 
C (Uj , . . u^ T=  C(v1...vk  )  then  if  w^...Wp  in  R*  obeys  jw^ |  +  ...  +  |w^|  e 


then  CCu^.-u^  ,w^...Wp)  =  CCVj, 


•  v. 


w^. . .Wp) . 


If  the  above  is  true  for 


any  e  >  0  then  we  say  that  C  is  causally  well-behaved. 


Note  that  all  of  the  above  definitions  are  "independent"  of  the 
decomposition  maps  and  C 2  discussed  earlier.  They  are  suggested  to 
indicate  the  flavor  of  the  thinking  undertaken  here,  and  must  be  viewed  as 
"first  efforts". 

2.  Well-Behaved  Coders  from  the  Decomposition  Viewpoint 
A  second  area  of  research  involved  the  problem  of  "behavior"  attacked 
via  the  decomposition  maps  and  C£.  The  one-dimensional  case  (n=l),  being 
general,  was  studied.  Appendix  B  to  this  report  details  a  theory  of  "good 
behavior"  for  the  map  C,  oriented  about  the  constraints  of  boundedness  and 
Lipschitz  continuity.  We  thus  do  not  discuss  the  details  of  this  here. 

Work  during  our  first  contract  year  sought  to  characterize  intuitively 
well -posed  "threshold"  maps  C^,  and  such  work  was  reported  last  year.  Some 
effort  was  made  during  the  current  contract  year  to  topologize  {0,1}*  so 
as  to  generalize  the  bounded  uniform  Lipschitz  constraint  to  C  directly — 
its  preliminary  nature  does  not  justify  its  inclusion  here. 


3.  "Similarity11  of  Coders  and  Related  Notions 

The  notion  of  similarity  of  coders  and  is  an  important  one.  As 
seen  elsewhere  in  this  report  many  synthesis  results  for  finitary 
and  other  types  of  coders  have  been  developed. 

Knowing  that  a  given  coder  is  "similar"  to  one  of  these  "canonical"  forms 
is  useful,  for,  within  the  allowable  tolerance  of  "practical  realizations" 
it  may  be  sufficient  to  realize  the  similar,  canonical  coder  in  lien  of 
the  given  one.  Furthermore  placing  a  metric  on  coders  may  allow  us  to 
appropriate  arbitrary  coders  C:  R*  -*•  {0,1}  by  (sequences  of)  coders  with 
finite  domain  ([2]  has  pursued  a  similar  approach  using  formal  grammars) 

For  these  reasons  a  brief  study  of  coder  sililarity  was  undertaken, 
motivated  by  work  in  pattern  recognition  theoretic  similarity  ([  7j).  By 
positing  the  definition  that  two  coders  C  and  CD  are  similar  if  their 

CX  O 

associated  languages  L(C  )  and  L(C_)  are  similar  as  sets  of  strings  of 

Ot  D 

real  numbers  (recall  that  for  C:  R*->-{0,l}  a  coder  L(C)  =  C-1{1}),  the 
problem  can  be  reduced  to  exploring  similarity  measures  amongst  subsets 
of  R*.  These  can  be  generalized  from  notions  already  developed  in  finite 
set  similarity  theory  or  from  similarity  measures  of  singleton  sets  (i.e. 
between  strings). 

4.  Asynchronous  Coders... The  Underlying  Framework 

Asyncrhonous  systems  must  explicitly  incorporate  the  notion  of  time — 
for  it  is  at  irregular  often  event-driven  times  that  transitions  can  take 
place,  etc.  Several  approaches  to  this  incorporation  are  possible.  One 
method  involves  explicitly  adding  a  time  variable  to  the  input  and  induced 
output  sequences  of  the  coder  map.  This  approach  will  be  explored  in 
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future  research  and  as  such  will  not  be  presented  here.  The  second  involves 
eliminating,  at  least  formally,  the  notion  of  discrete  time  and  working  with 
coders  whose  domains  are  functions,  instead  of  sequences.  Appendix  G 
to  this  report  examines  such  a  construct  called  a  functional  real 
coder.  We  chose  the  range  to  be  real  to  simplify  the  overall  flow  and  to 
better  isolate  the  theoretical  constructs  needed.  This  appendix  attempts 
to  generalize  the  fundamental  notion  of  unitary  coder  to  the  functional 
coder  case  and  shows  that  an  "extra"  condition,  that  of  essential  continuity, 
must  be  introduced. 

5.  Concluding  remarks:  Software  Realizations/Implementation  of  Coder 
Concepts 

Many  useful  algorithms  constructs  have  been  developed  over  the  past 
two  years.  Although  the  work  reported  above  was  theoretical,  the  potential 
for  syntax-directed,  linguistic  models  for  coders  can  be  made  a  reality. 
Further  research  can,  and  should  be  undertaken,  to  help  completely  automate 
coder  design  for  a  wide  class  of  coder  structures. 


■^3 
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during  his  sabbatical  leave  in  France)  have  been  held  throughout  the 
course  of  this  research,  and  a  strong  interaction  has  been  maintained 
amont  the  participants . 

In  June,  1981,  we  initiated  an  Invited  Session  on  Discontinuous 
Processes  at  the  Joint  Automatic  Control  Conference  held  in  Charlottes¬ 
ville,  Va.,  which  also  provided  a  unique  opportunity  for  discussion 
among  workers  in  this  field  of  research.  The  results  of  Appendix  A 
were  presented  here.  The  results  of  Appendices  B-F  have  or  will  be 
also  presented  at  conferences  according  to  the  citations  given. 

Professor  Kaliski  had  the  opportunity  to  discuss  the  results  of 
this  research  with  French  scholars  and  students  during  his  sabbatical 
leave  in  Paris,  and  to  explore  the  relationship  to  Petri-net  methods 
used  there  with  asynchronous  control  representations  explored  in  this 
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The  coder  realization  theories  presented  in  Appendix  A  lead  to 
practical  synthesis  algorithms  for  an  important  class  of  devices. 
Comparable  algorithms  already  find  very  wide  use  in  analog  filter 
and  linear  circuit  design  and  in  digital  circuit  design,  and  we 
recommend  that  the  development  of  algorithms  for  automatic  synthesis 
of  coders  and  decoders  be  pursued  as  an  important  technical  advance. 

Algorithms  for  feedback  control  design  have  also  been  suggested 
in  Appendix  H.  While  these  results  are  more  preliminary,  they  should 
definitely  be  pursued  because  they  represent  a  synthesis  method  for 
global  nonlinear  feedback  laws,  and  no  simple  or  effective  general 
solution  to  this  problem  are  currently  available. 

Potential  applications  to  robotics  and  multitasking  computer 
operating  systems  have  been  described  in  Appendices  E  and  F. 
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ABSTRACT 

The  notion  of  a  discrete-time  coder  as  a  device 
which  converts  real  vector-valued  sequences  into 
sequences  over  a  finite  alphabet  is  formalized.  A 
hierarchical  classification  of  all  coders,  in  terms 
of  their  input-output  mappings,  is  sought.  This 
classification  is  based  on  a  canonical  structure 
theory  being  developed  for  coders.  An  algebraic 
approach  is  used  to  define  three  classes  of  coders 
which  have  simple  canonical  realizations,  i.e.,  ones 
for  wh.ch  known  synthesis  procedures  may  be  used. 

It  is  proposed  that  coders  be  viewed  as  acceptors  of 
real  languages,  and  the  hierarchy  of  the  real  lan¬ 
guages  be  used  in  conjunction  with  the  hierarchy 
suggested  by  these  three  coders  to  achieve  a  com¬ 
plete  classification. 


NOMENCLATURE 

C  coder  mapping  R-  -  W 

Z(u)  the  length  of  a  sequence  u,  Z(A)  “0 

q  a  memoryless  quantisation  mapping,  q:  RP  •*  W 

Rp  p-dimensionai  real  Euclidean  space 

W  finite  set  of  coder  output  symbols 

e  set  membership  symbol 

a  next-state  mapping  of  a  finite  state  system 
3  readout  mapping  of  a  finite  state  system 
T  right  shift  transformation 

a  left  shift  transformation 

A  the  empty  string 

0  the  empty  set 

«  an  '  equivalence  relation 

X(te  the  set  whose  elements  are  the  equivalence  clas¬ 

ses  cf  X  modulo  as 
o  denotes  function  composition 

V  for  all 

SUPERSCRIPTS 

X*  the  free  monoid  generated  by  the  set  X 

X*  the  free  semigroup  generated  by  the  set  X 

f*  the  causal  extension  of  the  function  f 

INTRODUCTION 

Coders  and  decoders  here  are  devices  (such  as 
A/0  and  0/A  converters)  which  transform  real-valued 
sequences1 

^Any  sampling  in  time  is  assumed  to  have  taken  place 
prior  to  conversion. 


into  sequences  of  symbols  over  some  finite  alphabet 
and  vice-versa.  They  form  the  interconnection  be¬ 
tween  systems  whose  variables  evolve  on  the  continuum 
and  systems,  such  as  digital  computers,  which  have  a 
discrete  state  and  input  set.  Coders  and  decoders 
are  therefore  inherent  subsystems  in  hybrid  control 
systems  (U ,  where  the  plant  state  variables  and  out¬ 
puts  take- values  in  the  reals,  and  the  controller  is 
modelled  as  an  automaton. 

In  the  development  of  any  general  compensation 
scheme  involving  an  automaton  as  controller,  the  choice 
of  the  coder  and  decoder  should  be  included  in  the 
overall  design  process;  the  design  of  the  coder  and  de¬ 
coder  is  in  fact  central  in  the  compensator  synthesis. 
While  var;ous  hierarchies  of  automata  structures  exist 
(finite-state,  linear-bounded .  pushdown,  etc.)  pro¬ 
viding  the  necessary  design  constraints,  no  such 
classifications  exist  for  coders  and  decoders.  A  con¬ 
straint  on  the  coder  may  be  that  its  "continuous- 
state  part"  must  be  in  the  sxm.e  class  as  the  plant 
(for  example  finite-dimensional)  and  its  "discrete- 
state  part”  in  the  same  class  as  the  automaton.  Thus 
it  becomes  necessary  to  develop  a  canonical  structure 
theory  for  these  systems . 

Some  examples  of  coders  commonly  found  in  prac¬ 
tice  are  r.emoryless  quant i sers ,  quantisers  with 
hystersis  (2) ,  differential  quantisers  (3^)  and  re¬ 
settable  integrators.  A  quantiser  with  hystersis 
is  shown  in  Figure  1  below  and  may  be  realised  as  a 
quantiser  (different  from,  c)  followed  by  a  finite 
automaton.  Ke  will  call  coders  which  can  be  decom¬ 
posed  this  way  finitary  coders.  A  coder  which  is 
not  finitary  is  given  in  Figure  2. 

We  will  view  a  coder  as  a  map 


0  * 

where  is  the  set  of  all  finite  length  sequences 

p 

of  vectors  in  R  ,  an)  K  is  thv  finite  set  of  output 
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sym :!ioU  at'  the  coder.  A  decoder  performs  the  inverse 
operation.  It  has  already  been  shown  (£)  that  any 
coder  nay  be  realiced,  tor  n  >_  1,  as  a  composition 
or  an  n -dimensional  discrete-time  system  followed  by 
a  memory less  quanticer  (Figure  3),  i.e.,  as  a  com¬ 
position  of  maps  C^:  RP  ■*  Rn  and  q:  Rn  -»  w.  While 

this  decomposition  is  completely  general  it  is  not 
the  most  useful  one  in  terms  of  coder  synthesis. 

This  is  since  any  part  of  the  coder  that  would  nor¬ 
mally  be  synthesized  using  digital  logic  circuitry 
is  treated  as  part  of  the  discrete-time  system  with 

input  output  map  Cj,  with  states  talcing  values  in  Rn. 

Our  aim  will  be  to  develop  conditions  on  the  mapping 
C  for  the  coder  to  be  synthesized  using  standard 
circuit  synthesis  techniques.  It  is  thus  desirable 
that  these  conditions  result  in  realizations  of  C  in 
which  the  inherently  analog  and  inherently  discrete 
parts  are  identifiable.  The  results  that  are  pre¬ 
sented  here  are  preliminary  and  pertain  to  certain 
"simple  but  practically  useful"  coders;  in  general 
the  problem  concerns  the  realization  of  nonlinear 
discontinuous  mappings  and  is  difficult.  The  results 
for  decoders  are  similar  and  are  not  given. 


Definition 

Let  C  be  a  coder  and  consider  the  associated  set 

of  conjugate  trans  format  isms  C  *  {CTU:ucRp  1.  If  ~ 
is  finite  we  say  C  is  fir,  it  ary,  and  if  C  *  (C;  wo  say 
C  is  unitary. 

This  definition  is  just  Raney’s  (S)  definition 

modified  to  handle  sequences  over  RP.  Note  that  this 
notion  of  a  unitary  coder  is  only  useful  if  the  domain 

of  C  is  rP+-  A  minor  modification  in  the  definition 
is  necessary  if  one  wishes  to  define  unitary  coders 

n* 

on  Rr  .  We  will  clarify  this  later  on. 

Example 

+  A  quantizer  is  a  meaoryless  coder  with  domain 
RP  given  by 

Cfyr-*V  *  ^ 

where  q:  Rp  *  W.  C  is  clearly  unitary. 

Example 

C:  R*  -*■  W  is  defined  as 


NOTATION  AND  DEFINITIONS 


C(A)  *  1 


Definition 

A  coder  is  any  function 
C:  RP#  w  W 

where  W  is  a  finite  set  consisting  of  the  coder  out¬ 
put  symbols. +  Sometimes  the  domain  of  C  will  be  the 

semigroup  RP  ■  RP  -{A}  where  A  is  the  empty  string. 
In  the  sequel  the  domain  of  C  is  alw-ys  assumed  to 

n* 

be  R  unless  otherwise  indicated. 

To  view  a  coder  as  a  mapping  from  strings  to 
strings  we  define  the  causal  extension  of  C  to  be  the 
mapping 

C*:  RP*  «  W* 

obtained  by  extending  C  as  follows: 

C*  (A)  *  C(A) 

C*(yr..yk)  «  C(A)C(y1)...C(y1...yk) 

Definition 

Let  X  be  any  set. 


cCy^.y,) 


»  0  if  y^  0  and  the  number  of  non¬ 
negative  terms  in  k  is 

either  even  or  zero 

1  otherwise 


Then  C  »  {C^C^Cj},  C^.  R*  -  {0,1}  where 

C^  *  CtU,  ueU^cR*  for  i  *  1,2,3,  and 

U.  «  {ueR*:  the  number  of  nonnegative  terns  in 
u  is  odd,  and  the  last  term  is  negative} 

Uj  «  {ucR*:  the  number  of  r.onnegative  terms  in 

u  is  odd,  and  the  last  term  is  nonnegative} 

Uj  *  {ueR*:  the  number  of  nonnegative  terns  in 
u  is  even  or  zero} \j {A} 
and  thus  C  is  finitary. 


Example 

The  quantizer  with  hystersis  of  Figure  1  is 
defined  as 


CCA)  ■  wq 


Ca)  The  left  shift  transformation  o:  X*  -*■  X*  is 
defined  as  follows: 


ffx 


x(2)....x(k)  if  x  *  x(l)x(2)...x(k)  for 
x{i)eX,  k  >  l 

A  if  xeXU(A) 


We  extend  this  to  multiple  shifts  by  defining  o°  to 
be  the  identity  map,  ol  » c  and  on+^  *  ona. 


(b)  The  right  shift  transformation  r:  X*  -  X*  is 
defined  n 


C{y)  *  qCy  *  ad(w0))  yeR 

cCy^-Xj.)  *  q(>k  *  adCCCyj. . .yk  l) })  k  *2,3 — 

where  aeR,  w^rW  are  given  and  d  is  an  injection  of  W 

into  R.  Suppose  W  *  {a,£},  d(a)  *  -2,  d{S)  *  1, 
a  ■  1,  w  »  a  and  q:  R-(a,£}  is  the  napping 

q(y)  *  /  a  if  y  >  o 

I  S  otherwise.  Then  it  is  easy  to  see 

that  the  finite  state  syst-.-n  of  Figure  4  is  a  realiza¬ 
tion  of  C.  Ke  will  sec  that  this  implies  C  is  fir.itar> 
Note  that  a  dvconpos i tier  of  this  coder  in  the  form 
of  Figure  3  appears  unnatural. 

Alternate  descriptions  -f  unitary  and  finitary 
coders  nay  be  obtained  via  the  mechanism  of  Nerodc 


Tux  *  UX 


Yu,  xeX 


- - - w.;  p* 

let  u,v  bs  sequences  in  R  and  define  the 

P  * 

'.Serode)  equivalence  relation  (6)  as  on  Rr  as 


W  *  the  finite  output  Sit,  <  *  '•«  *  , . . .  wa  } 
6;  QxY-K)  is  the  .next-state  function  given  by 
5(ql.y)  *  q^  if  y--A{j  z  { 

3:  Q-Si  is  the  readout  function 


u  av  cj-.-'p  C(ux)  »  C(vx)  ¥  xeRP 

It  is  immediate  that  a  is  a  right-congruence  on 

?.*  .  The  following  proposition  is  also  evident,  and 
the  proof  is  left  to  the  reader. 

Proposition 

C  is  finitary  iff  a  has  finite  index. 

A  coder  which  is  not  finitary  is  the  shift- 
uni  tary  coder  defined  below. 

Definition  .  ♦ 

For  each  u£Rp  and  some  fixed  9eRp  define  the 

rj* 

shift-conjugate  functions  Cu:  R*^  ♦  W  of  C  as  follows: 
Cu(/3  «  Cx9  (A) 

Cu(yl",yk5  “  CT?Cyl'"yk)  k  *1 ,2, . . . ,  i( 9)-l 

CuCyl-"yk5  *  CT“^r"yk)  k  “  2(8) .  Z(0)+1, . . . 

Then  we  say  C^is  shift-unitary  if  fcu:  usRp}  »  (C } 
for  sone  9eRP  . 

Example 

Consider  the  coder  C  given  by 

c(A)  ■  0 

C(y)  »  sgn(y2-i)  ycR 


A  finite  automaton  (5)  is  defined  similarly  except 
that  Y  is  a  finite  set  ar.i  the  notation  M  is  used 
instead  of  >1^. 

Note  that  the  specification  of  5  defines  the  sets 
,  and  that  for  fixed  i,  the  sets  A^ ,  j  »  l,...,r 

fom  a  partition  of  Y. 

For  a  particular  initial  state  q^eQ,  the  re¬ 
sponse  function  of  M_  is  the  nap 


given  by 


- yfc)  *  BCS'Ca^.yj . yk))  k  «  1,2.... 

Definition 

C  has  meaory  spar.  X  if  X  is  the  smallest  non- 
negative  integer  such  that 

C(yr"yk)  -  C(yk  f( - yk)  k  •  N*1,.N*Z, - 

If  no  such  N  exists,  then  we  say  that  C  has  infinite 
memory  span. 

CODER  REALIZATION,  SYNTHESIS 


C(yr..yk)  »  sgn(y2-ykl}  k  *  2,3,... 

where  sgn:  R-»{0,1}  is  the  mapping 


A  unitary  coder  is  the  simplest  of  all  coders; 
it  is  memoryless.  This  is  the  statement  of  the  fol¬ 
lowing  Theorem. 


*«n(y)  *  1 


if  y  >  0 


0  otherwise 


Then  C  is  shift-unitary  with  9  *  (9.,1)  for  any 

V1’ 

The  definition  of  a  shift-unitary  coder  for  the 
case  where  2(8)  »  l  is  precisely  the  definition  of  a 

n* 

unitary  coder  with  domain  Rr  .  The  fact  that  a 
shift-unitary  coder  is  not  finitary  (except  for  when 
it  is  unitary)  will  become  evident  in  the  next  section. 


The  following  definition  will  be  useful  in  char- 
icteriring  finitary  coders. 


Dsfinitior, 

A  threshold  finite  automaton  (TFA)  is  the  5- 

tuple 


Theorem  * 

Rp  ♦  Kf  !.s  unitary  iff  there  exists  r  rip 
q:  Rp  *  W  such  that  for  all  y ^ - y^  t  Rp  , 

c(yj — yk)  *  qPk'1y1 — yk)  k  *  1.2,... 

Proof.  Necessity. 

First  define  the  sets  A.  for  each  w.ew  as  follows: 

1  1 

*  {ye Rp:  C(y)  »  w^ 

Then 

C(yi...yk)  »  (ct  1  )b\) 

*  C(yk)  since  C  is  unitary 


My  *  (Q,Y,K.5,3) 


Now  define  the  function 


w  is 


5  *  the  finite  set  of  states,  Q  *  (q!,...,qr) 
Y  *  the  input  set,  Y  C  Rp 


q(y)  *  «i 

Then 


if  vsA. 
1 


C(yr..yk) 


5u::uu?.cy. 

Suppose 

cc^.-.yj  =  q&k'1y1...yk) 

Q  P* 

for  sone  ^ap  q:  R  W.  Then  for  txR  , 

^TU\  "\  s>  «  *^-1  u-  ^ 


(C^Oy..^) 


and.  hence  C  is  unitary. 


yr..yk)  -  q(/k3 


1.2,... 

Q.H.D. 


The  synthesis  of  a  unitary  coder  therefore  in¬ 
volves  the  synthesis  of  the  map  q:  RP  ♦  W.  Note 
v  that  this  may  not  always  be  practical;  consider  for 
example  the  map 

q(y)  *  1  1  if  y  is  rational 

)  0  otherwise 

J  We  will  not  attempt  to  define  a  "well-behaved"  quan¬ 
tiser  hers. 

Finitary  coders  are  more  interesting;  they  are 
dynamic  and  in  general  have  infinite  memory  span. 

The  finitary  coders  are  precisely  those  coders  which 
are  finite-state  realisable.  This  is  stated  in  the 
following  theorem;  the  equivalent  result  in  automata 
theory  is  standard  (6),0. 

Theorem 

C  is  finitary  iff  C  is  the  response  function  of 
some  (minimal)  TFA. 

Proof.  Suppose  C  is  finitary.  Define  the  sets 
A„  »  {ysRp:  uye  U.  Yu  e  IK  } 

where  the  IK  C  Rp  are  the  congruence  classes  of  the 
right  congruence  «.  For  fixed  i,  the  sets  A^, 
j  *  l,...,r  clearly  fora  a  partition  of  Rp.  Wo  now 

construct  the  (minimal)  TFA  K_  »  (Q,RP,W,fi, g)  as 
follows : 

Q  »  C,  i.e.,  q1  »  C.  «  Ctu  for  uelK 
6:  QxRp-<!  via 

5(C.,y)  -  C./ 

8:  Q~W  via 


C./  *  CTU 
1 


for  ueli. 


C .  if  ye A.  . 
1  ij 


Ct  (A)  tor  usU. 


We  cake 


A  — 

Ct  =  C,  where  A t  J.  ,  and 
k  k 


Vq^l-V 


3(5‘(q1.y1...y;t)) 
8(Ct\  1  A) 

cfyi-ykJ 


H.  (A)  -  3(5*  (q.  ,A) )  »  C(A). 
4  * 


The  proof  of  the  converse  is  left  to  the  reader.  Q.E.D. 

The  coder  of  Figures  1  and  4  is  therefore  fin¬ 
itary.  The  following  result  separates  out  the 
threshold-type  operations  that  occur  in  the  TFA  real¬ 
ization  of  a  finitary  coder  from  the  dynamic  part, 
and  hence  tells  us  how  to  go  about  synthesizing  the 
coder.  This  decomposition  should  be  compared  with 
that  of  Figure  3. 

Theorem 

C  is  finitary  iff  C  may  be  realized  as  the  com¬ 
position  of  maps 

C  -  CjOC* 

p* 

where  C^:  Rr  *  V  is  unitary,  V  is  a  finite  set.  and 
Cji  V*  W  is  finite-state  realizable. 

Proof.  Suppose  that  C  is  finitary.  Then  by  the 
previous  theorem,  C  is  the  response  function  of  a  re¬ 
duced  TFA  Hj,  *  (Q,RP,W,5 , 5) .  Define  the  functions 
q.  as  follows; 


qt:  RP-  U . rl 


1 . r 


where  the  A^C  Rp  were  defined  in  the  proof  of  the 
previous  theorem,  r  is  the  cardinality  of  Q.  Now  de¬ 
fine  q:  RP  »  (l . r)  r  *  V  as 

q(y)  *  (qjCy) . Rr(y)) 

n* 

and  take  C^:  R  ■*  V  to  be  the  map 


c2(yr-.yk) 


where  v  is  any  vector  in  V  with  *  l . 

Clearly  C,  is  unitary.  Define  the  finite  automaton 
M  »  (C,V,fi,5,8)  as  follows; 

(a)  5:  C  x  V  *  C  via 


5(ci.v)  *  veV 

:  V  -  (1 . r;  is  the  projection  mapping 

p^(v)  *  ith  component  of  v 


4 


(b)  a:  C  -  -1  '•  ia 


Lit  0^  oe  the  response  function  :  V*  —  W  where 

q,  =  C  (suDOOSe  At  U. ) .  'Then  we  hive  that,  for 
_  l  ‘  ‘  1 

y-:A?, 


3(Ci.o(y)) 


%(/) 

fj  uy*ij 

i(CvY) 


Now, 


(Cl0C2*)(yx...yk)  -  ^(CjQJCjCyjDCjCy^)... 

...C,(y1...y)cn 

*  Cx(v  q(yx) . .  .q(yk)) 

-  S «* (qx ,v  q(yx) . .  .q(yk) ) 

*  3(5*(q1.q(y1)...q(yk)))  since 

iTCq^v  )  *  qt 

*  s«*(q1.yI---yk)) 

*  CCyx...yk). 

The  proof  of  the  converse  is  left  to  the  reader. 


C(A)  *  qO) 

♦ 

where  ?.P  is  the  sequence  (of  length  N  >_  1)  aopear- 
ing  in  the  definition  of  a  shift-unitary  coder. 

* 

Proof.  For  any  sequence  yl...ykc?.p  and 
1  _<  i,  j  <  k  define 

B(y;  i,j)  $  yi...yj 

Also  define  the  sets  Y^.V  for  each  w  as  follows: 
Yi  ^  (yeRP#  :  i(y)  >  S  and  C(B(y;  l.N))  . 

^  {B(y;  1,N)  :  ySY.>. 

Now  define  the  map  q:  RpxR*-W  as 
q(y)  *  W.  if  ycA^. 

Then,  for  yeRp  with  i(y)  »  N, 

oMC*(yJ(l)  =■  C(yj...  ys)  •  wx4^  q(B(y;  l.N)).*.^ 

and  for  yeRP  ,  with  2(y)  *  it  *  N*a  for  some  integer 

o  >  0, 

«kC*(y)(l)  =  C(yi...yk)  .  c/r"SnCy1...yk) 

»  Co"(y1...yk)  since  z(oIBy1...yk)  >  t(e) 

*  oNC*(aay)(l)  by  defn.  of  C* 

*  q(B  (omy;  l.S))  since  2(a“y)  ■  S 
-  q(B(y;  k-N*l,k)) 

For  i(y)  »  k,  1  <  k  <  N, 


Q.E.D.  C(y)  -  Cu(y) 


Application  of  these  results  to  the  coder  of 
Figure  4  results  in  the  realization  shown  in  Figure 
5. 


Not  all  coders  with  inherently  discrete  dynamics 
are  finitary;  the  coder  of  Figure  2  has  a  countable 
state  set.  Extensions  of  the  above  decomposition 
result,  where  the  isolated  automaton  is  a  determin¬ 
istic  pushdown  automaton  (6)  are  currently  being 
investigated.  Note  that  in  this  case  a  feedback- 
free  decomposition  cannot  be  obtained  in  general. 


CT9l"’0k«7kT9y) 


C(okT0y)  since  i(jK T9y)  >  i(3) 


q(B  (akx9y;  l.N)) 
q(ak3y) 


The  shift-unitary  coders  are  perhaps  the  sim¬ 
plest  class  of  coders  with  realizations  that  have 
inherently  analog  dynamics  and  are  finite-dimension¬ 
al.  These  codzrs  have  finite  memory-span  (i.o.  nil- 
potent)  and  may  be  implemented  with  a  single  (real 
number)  storage  register  and  a  quantizer.  This  is 
the  result  of  the  following  theorem. 


Finally,  for  y  »  A 
C(A)  -  CU(A)  »  Ct9(.\) 

*  CO) 

*  q(B  O  ;!.'•}) 


Theorem 

It  C  is  shift-unitary  then  there  exists  a  map 
q:  RP.tR  ’  -  W  such  that 

CC/i*”;V  ■  MC.vk.SM..:.yk)  k  >N 


*  q(a).  q.e.d. 

It  should  be  clear  that  the  memory  span  of  a 
shift-unitary  coder  is  finite,  and  is  equal  to  l(5)-l. 
(Note  th3t  although  5  may  not  be  unique,  tO)  is.) 

For  these  coders,  usv  is  equivalent  to  the  statement 


•Vi—V 


1  <  k  < 


i(u)a 
c  '9  u 


».(v)„ 
a  3  v 


S 


jj*  D  X  N 

and  hsnci  R-  /as  is  isomorphic  to  l'  .  The  exten¬ 
sion  to  shirz-finitary  coders  is  currently  under  in¬ 
vestigation. 

The  exxmple  of  the  shift-unitary  coder  given 
above  nay  he  realited  as  shown  in  Figure  6. 

CONCLUSIONS  AND  DISCUSSION 

We  have  formalized  the  notion  of  a  discrete- 
time  coder  and  have  exhibited  canonical  structures 
for  three  classes  of  coders,  the  unitary,  finitary 
and  shift-unitary  coders.  We  have  indicated  that, 
from  the  point  of  view  of  synthesis,  coders  and  de¬ 
coders  should  be  viewed  as  hybrid-state  systems;  the 
major  task  is  to  define  classes  of  coders  and  de¬ 
coders  which  have  identifiable  discrete-state  and 
continuous-state  parts.  A  finitary  coder  realized 
in  the  general  form  shown  in  Figure  3  may  still  be 
easily  synthesitable  (the  coder  of  Figure  7  is  an 
example).  However,  this  is  not  always  the  case  and 
is  the  reason  for  the  algebraic  approach  we  have 
adopted. 

We  have  also  shown  that  a  definite  hierarchical 
classification  of  coders  exists.  To  aid  in  this 
classification,  a  coder  may  be  viewed  as  an  acceptor 
16)  of  real  languages.  A  hierarchy  of  these  lan¬ 
guages  exists  similar  to  the  hierarchy  of  languages 
studied  in  the  computer  science  literature  (regular, 
context-free,  context-sensitive,  etc.).  Real  con¬ 
text-free  languages  and  their  generating  grammars 
have  been  studied  by  Lemone  (8) .  The  language  ac-  ‘ 
ceptsd  by  the  coder  of  Figure  2  can  be  shown  to  be 
context-free,  while  no  language  accepted  by  a  shift- 
unitary  coder  is  context-free  unless  the  coder  is 
unitary.  The  real  regular  languages  form  a  proper 
subclass  of  the  real  context-free  languages,  and  are 
precisely  the  languages  accepted  by  the  finitary 
coders  (£) . 

Coders  form  one  subclass  of  the  nonlinear  dis¬ 
continuous  mappings  for  which  a  realization  theory 
can  be  developed.  It  is  the  fact  that  the  domain  of 
a  coder  mapping  is  a  finite  set  that  has  enabled  us 
to  draw  on  many  of  the  ideas  and  results  in  the  field 
of  computer  science. 
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Figure  7  A  finitary  coder 

(1)  Specification  as  a  TFA 

(2)  Realisation  in  the  for:  of  Figure  3: 

q  :  R-{-l,l)  via  q,:  R— {0 , 1 >  via 
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ABSTRACT 


This  paper  examines  certain  aspects  of  the  realizability  of 
input/output  maps  f:  R*  •*  R  by  one-dimensional  non-linear 
discrete-time  systems,  where  R*  is  the  free  monoid  on  the  reals 
R,  under  the  operation  of  string  concatenation.  Realizations 
are  sought  which  are  bounded  and/or  Lipschitz.  A  natural  connection 
between  such  constrained  realizations  and  the  string-processing 
properties  of  the  input/output  mapping  is  shown  to  exist.  These 
results  have  further  implications  for  the  synthesis  of  general 
analog/digital  coders  and  decoders  which  find  uses  in  computer 
control  system  interfaces. 


I.  Introduction 


The  purpose  of  this  paper  is  to  explore  certain  aspects  of  the 

* 

realizability  of  maps  f:  R  ■*  R  by  one-dimensional  discrete-time 

r  ^ 

<  systems,  where  R  is  the  set  of  all  finite-length  sequences  of  real 
numbers,  including  X  the  null  string.  The  discrete-time  systems 
considered  are  of  the  following  form: 

**  + 1 ' F<v  UkK  *  *  lr  2'  —  a) 

xQ  the  initial  state 
2 

where  F:  R  +  R  is  the  state-transition  map. 

By  the  realizability  of  f  we  mean  that  f  is  the  input/output 
map  associated  with  (1)  ,  i.e.  there  exist  F  and  Xg  such  that 
f(X)  *  xQ 

and,  for  uoulu2'*’  u^  arbitrary,  k  >_  0, 

f(  Ug. .  .uk)  =*^F(.  . .  (F(F(xq,  uQ)  ,iij)  ,u2)  ,...,1^) 

We  consider  below  several  aspects  of  the  realizability  problem: 

(A)  .  Realizability  by  systems  wherein  F  obeys  no  other 

constraint  than  being  well-defined. 

(B)  Realizability  by  systems  wherein  F  is  bounded ,  i.e.  for 

2 

some  Bg  >_  0,  -Bg  £  F(v)  <_  Bg  for  all  v  in  R  . 

and 

(C)  Realizability  by"  systems  wherein,  in  addition  to  the 

boundedness  constraint,  F  obeys  a  Lipschitz  condition  for 

2 

some  Lg  0 ,  i.e.  for  all  v,  w  in  R  . 

|F(v)  -  F(w)  |  <_  Lg  [I  v  -  w  i  | 

2 

We  will  take  the  norm  above  to  be  any  fixed  norm  on  R  . 


f 


This  paper  will  develop  several  general  theorems  yielding  both 
necessary  and  sufficient  conditions  for  the  realizability  of  maps  f 
by  systems  of  types  A,  B,  and  C,  above.  Note  that  as  no  assumption 
is  made  here  about  f  being  onto  all  of  the  results  below  hold  even 
if  range (f)  is  a  finite  subset  of  the  reals. 

The  problem  of  realizing  input/output  maps  by  (nonlinear)  discrete¬ 
time  systems  is,  in  of  itself,  not  a  new  one.  Studies  of  this  type  in 
the  mathematical  systems  theory  literature  (e.g.  Kalman,  Falb,  and 
Arbib,  1969)  have  been  available  for  several  years.  What  is  new,  we 
feel,  in  the  aspects  of  the  realizability  problem  considered  here, 
are  the  following  two  viewpoints. 

First,  that  such  natural  regularity  requirements  as  boundedness 
and,  "Lipschitzness"  lead  to  input/output  properties  expressible  as 
string-processing  requirements.  Second,  that  this  one-dimensional 
problem  is  actually  sufficient  to  represent  higher-order  finite-di¬ 
mensional  problems  as  well.  This  is  based  on  our  earlier  work 
(Kaliski  and  Lemone,  1980)  dealing  with  the  realization  of  real 
acceptory'coders  by  one-dimensional  systems. 

II.  The  Basic  Result:  Well-Posed  State  Transition  Functions 
Let  f:  R  be  a  given  input/output  (I/O)  map. 

Theorem  1:  f  is  realizable  by  a  system  of  the  form  (1)  if  and  only 
if  f  obeys  the  following  property^-: 

* 

for  all  un...  u.,  v„...  v  in  R  ,  r  in  R, 
u  x,  u  m 

f(u0...  ut)  =  f(v0...  vm) 

f(u0...  u4  r)  =  f(v0...  vm  r) 

(Note:  Either  un...  u„  or  vn...  v  may  be  null  in  the  above  statement.) 
u  %  u  m 

Proof :  That  any  map  realized  by  the  system  (1)  obeys  the  above  property 
is  clear.  Conversely,  suppose  that  f  obeys  this  property. 


Set  K  =  range  (f).  Define  a  map  G:  K  x  R  -*■  R  as  follows.  To  compute 

★ 

G(a,  b)  find  a  string  uQ...  u^  in  R  such  that  a  -  f  (Uq...  u^)  ;  set 
G(a,  b)  equal  to  f(uQ...  u^  b) .  G  is  well-defined  by  virtue  of  the 
^  assumed  property  for  f.  Extend  G  arbitrarily  to  a  map  F:  R^  -*■  R 

and  set  xQ  =  f (A)  .  The  system  (1)  with  transition  map  F  then  realizes  f 


Thus  we  have  characterized  realizability  of  type  A. 

III.  Adding  Constraints  of  Boundedness 

Adding  the  constraint  of  boundedness  by  BQ  yields  the  following 

Theorem  2:  f  is  realizable  by  a  system  of  the  form  (1)  with  |f(v) [  <  B 
2 

for  all  v  in  R  if  and  only  if  f  obeys  the  property  below: 

* 

for  all  Uq . . .  ,  vQ . . .  in  R  ,  r  in  R 

(i)  f(uQ...  uz)  =  f(vQ...  vm) 

->  f ( Uq • • •  U£  r)  =  f(VQ...  vm  r) 

(ii)  |  f  (uQ. . .  u^  r)  (  <_  B0 

(Note  again  that  either  Uq.v.  .  u^  or  vQ...  vm  or  both  may  be  null.) 

Proof :  Necessity  is  clear.  Conversely  let  K  and  G  be  as  in  the  proof 

of  Theorem  1.  From  the  given  property  for  f,  |G(v) [  £  Bq  for  all  v 

2 

in  K  x  R;  extending  G  to  all  of  R  so  as  to  retain  this  bound  is 
trivial.  The  rest  of  the  proof  is  immediate. 


We  next  turn  to  realizability  of  type  C. 

IV.  Adding  the  Lipschitz  Condition 

We  begin  this  section  with  the  following  Lemma,  whose  proof 
1971)  #.  (Cssipaaar  and  Gahar,  1955) . 


I 
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2 

S  be  a  given  subset  of  R  ,  h:  S  -*■  R  a  map  satisfying  the  conditior  i 
below  for  all  v,  w  in  S,  for  some  non-negative  real  constants  Bg,  Lg, 
and  for  some  norm  on  R2. 

(i)  |h(v)  -  h(w)  |  1  Lg  | v  -  w  | 

(ii)  | h(v) |  <  Bg 

\ 

2 

Then  the  map  Hs  R  -*■  R  defined  by 

H(z)  =  max  (-BQ/  min  (Bg,  ^gl£  g(h(y)  +  LQ[(z  -  £|)  ) 

is  indeed  well-defined,  is  an  extension  of  h,  and  obeys  for  all  v,  w 
2 

in  R  (i)  and  (ii) ;  above,  with  h  replaced  by  H. 


We  will  use  the  above  Lemma  in  proving  the  following  result. 

Theorem  3:  f  is  realizable  by  a  system  of  the  form  (1)  with  |F(v)  |-  <_  bq, 
and  |F(v)  -  F(w)  |  <_  lq  |v  -  w  |,  for  all  v,  w  in  R2  if  and  only  if  f 
obeys  the  property  below: 

for  all  Ug...  u^,  Vg...  v^  in  R,  r,  s  in  R 
(i) .  |f(u0...  u£  r)  -  f(v0...  vm  s) | 

1  Lg"!!(  f(Ug...  u4)  ,  r)  -  (f(v0...  vM)  ,  s)  [! 

(ii)  |  f  (Ug.  .  .  r)|  <  Bg 


(Note  that  condition  (i)  of  Theorem  3  implies  condition  (i)  in 
Theorems  1  and  2;  also  Ug...  u^  or  Vg...  VM  or  maY  be  hull.) 

Proof:  Again  necessity  is  clear,  as  if  such  a  system  exists, 
f(u0...  ua  r)  =  F  (f(u0...  u^) ,  r) 

£(v0...  vm  ■)  =  F  (f(v0...  vB),  s) 


As  for  sufficiency,  again  define  G  and  K  as  in  the  proof  of  Theorem  1. 
From  condition  (i)  it  is  easy  to  see  that  G  is  we  11-de fined,  from  our 
remark  following  the  Theorem  statement  above.  Setting  S  *  K  x  R,  and 
h  =  G  it  is  also  clear,  from  the  assumed  property  for  f,  that  the 
conditions  of  the  Lemma  hold.  Setting  F  =  H,  and  Xg  =  f(X)  completes 
the  proof. 

QED 

In  resolving  question  C,  then,  we  have  the  following  intuitive 
interpretation  of  the  constraints  needed  on  f '  (viewing  the  norm  as 
being,  for  example,  the  p  =•  1  norm)  :  sequences  producing  "similar" 
f-values,  followed  by  close  together  real  numbers,  must  in  turn  produce 
"similar"  f-values;  all  such  f-values  must  be  bounded  in  magnitude  by 
Bq.  The  second  use  of  similar  is  taken  to  mean  "up  to  LQ  times  as 
different"  as  the  first  use  of  similar. 

V.  Discussion;  Limitations  of  the  Theory 

We  address  several  issues  briefly  in  this  concluding  section. 

First  we  address  the  obvious  limitations  of  the  theory:  the  systems 
considered  are -one-dimensional  with  the  further  constraint  that  the 
output  is  the  state.  It  is  only  in  the  context  of  a  constrained 
setting  of  this  kind  that  we  can  obtain  such  a  concise  set  of  conditions 
for  realizability.  More  general  systems  settings  will  imply  more 
complex  statements  of  constraints  on  f. 

Nonetheless,  in  defense  of  these  limitations,  it  should  be  pointed 
out  that  theoretically,  at  least,  (Kaliski  and  Lemone,  1980)  ,  one- 
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dimensional  realizations  of  the  type  considered  here  are  sufficient 
for  coding  purposes. 

An  essential  component  in  the  design  of  finite-state  compensators 

r.  for  discrete-time  continuous -state  plants  is  the  coder,  a  map 
* 

C:  R  -*■  {0,  1}  (Johnson,  1978).  Such  a  coder,  which  forms  an  inter¬ 
face  between  the  plant  and  the  compensator,  can  always  he  realized  as 

* 

the  composition  of  two  maps:  a  map  f:  R  -*■  R,  and  a  map  g:  R  {0,  1} 
(a  threshold  device) ,  i.e.  C  =  g  f.  (Kaliski  and  Lemone,  1980)  . 

The  importance  of  finite  state  compensation  as  a  design  tool 
has  thus  renewed  interest  in  coder  design  (Jones,  1978),  (Wimpey,  1980), 
(Kaliski  and  Johnson,  1979) ,  and  spurred  research  in  related  areas 
of  finite-state  regulator  theory  (Gatto  and  Guardabassi,  1976) . 

It  is  then,  in  this  context,  that  we  address  the  questions  of 
this  paper.  With  the  basic,  theoretical,  understanding  achieved  here 
we  hope  to,  in  subsequent  research,  bridge  the  gap  to  somewhat  more 
practical  approaches.  As  a  theoretical  result,  then, Theorem  3  has 
considerable  intrinsic  interest. 
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VIII.  Footnotes 

^This  property  is  equivalent  to  the  finitariness  of  f  when  f  has  finite 
range  (see  (Wimpey,  1980)  )  . 
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ABSTRACT 

Diced  systems  are  defined  as  autonomous  systems 
governed  by  ordinary  differential  equations  having  dis¬ 
continuities  (in  Rn)  on  submanifolds  where  one  or  more 
of  the  state  variables  takes  an  integer  value.  Such 
systems  nay  be  regarded  as  approximations  of  continuous 
systems  or  as  representative  models  of  a  class  of  dis¬ 
continuous  systems.  Trajectories  of  such  systems  (for 
a  given  initial  state)  are  readily  calculated  and  may 
exhibit  complex  sliding-mode  segments.  Asymptotic 
properties  of  such  trajectories  are  discussed  and  clas¬ 
sified.  Motivation  is  given  in  terms  of  observed  prop¬ 
erties  of  interconnected  power  systems. 

J.  Introduction 

Diced  systems,  as  defined  here,  are  finite-dimen¬ 
sional  autonomous  continuous-time  dynamic  systems  gov¬ 
erned  oy  equations  of  the  form  (t)  «  f(x(t)); 
x  (t  )  »  x  eRn,  t  >  t„,  where  f  :  Rn  ■*  Rn  is  piecewise- 
constant  with  discontinuities  only  on  the  surfaces 
where  one  or  more  coordinates  of  Rn  take  integer  values. 

A  diced  system  in  R2  is  very  easy  to  illustrate:  the 
plane  can  be  divided  into  a  uniform  gird,  and  within 
each  square  a  vector  representing  the  magnitude  and 
direction  of  f  is  shown  (Figure  1) . 


Existence  and  uniqueness  of  a  solution  for  any 
fixed  initial  state,  xQ  can  be  studied  using  a  general¬ 
ization  of  the  method  introduced  by  Filippov  [lj;  tra- 
ectories  may  exhibit  sliding  node  segments  and  higher- 
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ET-76-C-0102295)  and  the  U.S.  Air  Force  Office  of  Sci¬ 
entific  Research  (Contract  F49620-80-C-Q002). 


order  non-differentiable  behavior  as  illustrated  in 
Figure  1.  In  order  to  obtain  existence  of  solutions, 
multivalued  extensions  of  f  onto  its  discontinuity 
surfaces  are  required.  Every  trajectory  can  bm  re¬ 
presented  by  a  sequence  of  transition  points  and  times, 
(x(ti),ti  l 

Definitions  of  various  types  of  stability  and  in¬ 
stability  can  be  constructed  from  an  examination  of 
the  invariant  limit  sets  [2J  of  the  trajectories.  For 
diced  systems,  the  range  of  asymptotic  behavior  of  tra¬ 
jectories  starting  from  different  initial  conditions 
can  be  exceedingly  rich.  The  possibility  of  approximate 
global  stability  analysis  using  nondeterministic  automata 
is  examined  and  its  limitations  are  indicated. 

In  practice,  diced  systems  might  be  viewed  as  ap¬ 
proximations  of  continuous  or  discontinuous  systems. 

In  the  former  case,  for  instance,  we  might  seek  the 
best  piecewise-constant  (finite-element)  approximation 
to  a  continuous  system.  Nang  [3]  has  presented  an  ap¬ 
plication  of  this  type  for  solving  partial  differential 
equations.  In  the  latter  case,  a  state  space  diffeo- 
morphlsm  might  be  used  first  to  transform  the  discon¬ 
tinuities  of  a  system  to  lie  along  coordinate  axes,  and 
then  a  diced  approximation  could  be  developed  which 
would  preserve  the  discontinuous  behavior  of  such  sys¬ 
tems.  The  potential  practical  advantages  of  diced  ap¬ 
proximations  lie  in  a  reduction  of  information  storage 
required  to  characterize  a  system  and  the  possibility 
of  assessing  its  approximate  asymptotic  behavior  without 
a  detailed  simulation. 

For  example,  at  the  tine  of  a  known  failure  of  a 
power  system,  it  is  often  desirable  to  predict  the  long¬ 
term  consequences  of  various  control  strategies  so  that 
an  operator  can  decide  among  them.  Yet  the  system  is 
too  big  to  store  all  possible  consequences  in  advance. 

A  practice  which  has  thus  been  followed  in  some  cases 
[4]  is  to  run  a  simulation  "faster  than  real-time"  fOT 
each  control  strategy.  Nhile  the  issue  of  approximation 
accuracy  is  not  treated  here,  the  results  suggest  that 
significant  economy  of  real-time  computation  might  be 
achieved  by  approximating  the  dynamics  of  a  diced  sys- 
ten.  However,  they  also  suggest  that  the  patterns  of 
stability  and  instability  exhibited  by  such  discontinuous 
systems  may  be  highly  complex  and  that  analytical  methods 
are  not  likely  to  yield  clear-cut  predictions  about 
global  stability. 

II  Preliminaries.  Notation 

Let  i  «  [ij . in]eZn  *'e  *  multi-index  on  the  n- 

tuples  of  integers  (Z).  Let  b  «  [bj . bnJcBn  repre¬ 

sent  an  n-tuple  of  binary  numbers  (1  ■  (0.1)).  Let 
X.(x):  Rn  ■*  R  be  tho  characteristic  function  of  the 
open  set  (x  »  [Xj, . . . ,xn]cRn  )  1^  <  x^  <  i^  »  1, 
k  •  l,2,...,n]. 
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Definition:  A  diced  initial  value  problen  (DIVP) 
is  specified  by  a  systea  of  ordinary  differential 
aquations 

x(t)  •  f(x(t))  ;  x(to)  *  xoeRn  ;  t  >  tQ  (2.11 

where  f  :  Rn  ♦  Rn  has  the  particular  fora 

f(x)  *  I  fbi  X.W  I  b  -  OeBn  (2.2) 

i£Zn 

and  f  . ERn  for  each  multi-index  i. 

01 

The  surfaces  of  discontinuity  of  f  aay  be  classi¬ 
fied  by  their  dimension.  Let  J_(h)  :  Bn  •*  fl,...,n)  be 
a  function  denoting  the  nuaber  of  "l"’s  in  the  binary 
n-tuple  b.  For  fixed  ieZn,  consider  the  sets 

Sbi  -  (xcRn  I  lk  <  \  if  b.  -  0 

ik  •  x^  if  b^  ■  1,  k  «  1,2 . n)  (2.3) 


ing  to  infinity  as  n-*“,  so  that 

lia  |  l<*,C*n»t0*x0)  ~  P  1 1  *  0  (2.5) 

IT** 

In  applying  these  definitions  it  will  be  useful 
to  recall  that  a  function  x(t)  is  periodic  of  period 
T  >  0  if  x(t)  »  x(t+T)  for  all  t;  "the"  period  of  a 
periodic  function  is  defined  as  the  least  T  for  which 
this  equality  holds. 

1X1  Existence  and  Uniqueness 

Consider  the  DIVP  (2.1),  (2.2).  Defining  solutions 
within  the  cubes  SQi  by  integration  is  entirely 

straightforward;  all  difficulties  arise  in  attempting 
to  extend  solutions  across  the  discontinuity  surfaces 
of  f;  in  general,  there  is  no  unique  continuation. 
Various  possibilities  are 

(a)  To  restrict  the  class  of  f  so  that  continuations 
are  always  unique  (this  is  very  restrictive  indeed,  and 
essentially  eliminates  many  interesting  phenomena  from 
consideration) . 


These  nay  be  viewed  as  the  set  of  subnanifolds  "at¬ 
tached  to"  the  point  x«i.*  For  exaaple  Soi  is  the 

interior  of  the  n-dinensional  cube  indexed  by  its  ver¬ 
tex  at  x«i;  S1A  (the  shorthand  1  denoting  b  *  [1,1,..., 

1])  is  the  single  point  x«i.  The  subnanifolds  of  di¬ 
mension  p  associated  with  x»l  are 

Si  *  {Sbi  I  1(bJ  *  n'pl  P  *  0,1,... ,n.  (2.4) 

This  notation  provides  a  compact  classification  of  all 
of  the  subsets  of  Rn  which  are  of  interest. 

In  Section  III,  conditions  for  well-posedness  of  a 
DIVP  are  examined.  This  is  done  by  extending  f  to  its 
discontinuity  surfaces  (from  (f  ),  we  generate  (f. 

•  p  Ol  D 1 

b  t  OcB  ) .  Then  a  constructive  procedure  can  be  used 
to  generate  solutions  x(t)  ■  ♦(t.t  ,x  )  for  each  x  er" 

O  O  0 

tQeR  and  hence  to  define  the  transition  nap 

♦:  R  x  R  x  Rn  ■»  Rn.  Let  X  denote  the  function  space 
in  which  trajectories  are  defined.  This  leads  to  the 
following 

Definition:  A  diced  systea  is  an  autonomous  dynam¬ 
ical  system  (x,Rn,«)  (See  [SJ). 

Stability  has  been  viewed  as  a  qualitative  property 
of  a  dynamical  system,  and  concerns  the  asymptotic  be¬ 
haviors  of  trajectories  x(-)  ■  ${•,  t  ,x  )  as  x  ex  is 

0  0  0 

varied.  Stability  of  diced  systems  is  discussed  in 
Section  IV.  Two  useful  notions  will  be  those  of  the 
positive  limit  set  and  the  invariant  set  [2]. 

Definition:  The^set  ft  C  Rn  is  invariant  with  re¬ 
spect  to  the  system  x(t)  *  f(x(t),t)  if  for  any  x0Cll 

there  is  a  t  such  that  the  motion  i(t,t  ,x  )  belongs 

O  0  0 

to  ft  for  all  t  >  t  . 

~  O 

Definition:  fhe  set  H  C  Rn  is  celled  the  positive 

limit  set  of  a  bounded  motion  $(t;t  ,x  )  if.  for  any 

o  o 

point  pcH,  there  exists  a  sequence  of  tines  *t  5  temi- 

h 


•The  obvious  injection  of  the  integers  into  the  reals 
is  implied. 


(b)  To  eliminate  the  non-continuable  surfaces  from 
the  domain  of  f;  however,  then  all  points  on  all  tra¬ 
jectories  leading  to  such  surfaces  must  also  be  elim¬ 
inated,  and  a  large  part  of  the  original  domain  of 
definition  may  ultimately  be  excluded. 

(c)  To  choosa  an  ad  hoc  rule  for  continuation  of  sol¬ 
utions;  however,  it  proves  difficult  or  impossible  to 
do  this  in  a  self-consistent  and  unbiased  manner. 

A  fourth  alternative  has  been  selected  here: 

(d)  To  sacrifice  uniqueness  and  continue  all  solutions 
through  a  discontinuity. 

In  this  way  a  viable  deterministic  existence  theory  can 
be  developed,  at  the  cost  of  considering  a  countable 
number  of  alternative  solutions.  A  "physical"  justi¬ 
fication  for  adopting  this  approach  is  that  in  the 
presence  of  small  perturbations  of  the  initial  condi¬ 
tions,  a  solution  near  to  at  least  one  alternative  so¬ 
lution  will  occur. 


A  constructive  procedure  is  given  for  defining  so¬ 
lutions.  To  simplify  its  presentation,  a  multivalued 
continuation  of  f  to  the  surfaces  S^»  b  t  0,  is  first 

defined.  Initially,  f  is  specified  on  the  submanifolds 
s”  •  {SQi)  of  dimansion  n.  The  continuation  proceeds 
recursively  to  submanifolds,  S?  of  dimension  n-1,  n-2. 
...,C.  Recall  that  S°  is  the  point  set  (xcRn|a  •  i^, 
an  integer).  Notationaily,  a  single  valued  ffei  will 
not  be  distinguished  from  a  multivalued  f^,  the  impli¬ 
cation  being  that  tha  prescribed  rule  is  applied  to  each 
possible  value  of  f^^  in  turn,  and  the  set  of  all  results 

is  retained.  Let  p»n.  Suppose  f. ,  are  known  on  S?, 

8*  -  |  ^ 

p  <  q  <  n.  Then  f.  .  can  be  extended  to  S?  as  follows, 
—  _  ox  1 

for  each  id  . 


Suppose  S..CS?"1.  Let  indices  j,...j  ,,  denote 

oi  l  j  n-ip-ij 

the  ordered  noniero  positions  of  b,  i.o.,  b.  »t.  k*l, 

Jk 

n-(p-l)  and  b  *0  otherwise.  The  neighborhoods  of  S. 

J  01 

of  dimension  qf  p  <  q  £  n,  can^be  defined  as  follows. 

For  q*n,  consider  all  indices  *  fonned  by  decrementing 


111! 


i  by  one  for  any  subset  of  the  subindices  k»l,..., 

J  n 

n-(p-l),  including  the  null-set;  then  SgjESr  is  a 
neighborhood  of  Sbi  where  b  »  0.  For  q  *  n-1,  consider 

all  values  b  having  a  single  "one^  in  one  of  the  posi¬ 
tions  jj..  •  in_  (p.L)  an<1  for  each  forn  I  from  lhe  r«* 

■Mining  n-Cp-l)-l  indices  as  above;  then  SgjeS?*1  is  a 
neighborhood  of  &.*  For  q  •  n-2,  consider  all  values 
b  having  "ones"  in  any  two  of  the  positions  jj,..., 
j  n-  (p- 1 )  ^roa  elctl  b  and  I  from  the  remaining 

n-(p-l)-2  indices  as  above;  then  SgreSr'2  is  a  neigh¬ 
borhood  of  S^.  This  procedure  is  continued  until  q*p. 

Tk-  1.—  1 -  „  C  e  —  e  rC-P'  1  ....  J— . i 1  - _ 


The  values  of  f.  .  or-  3.  .  ES?” 

bi  bi  l 


are  determined  from 

C _ CS? 


the  values  of  fgj  on  each  of  its  neighborhoods 

p  M  <  n.  It  is  thus  sufficient  to  give  the  procedure 
for  determining  ffai ,  assuming  that  these  values  on 

higher-dimensional  submanifolds  are  known  (t.e. ,  the 
values  can  be  determined  recursively) .  Define  Sgj  to 

be  an  input  submanifold  to  Sj^  if  (fgj)t  *  0  for  all  t 
such  that  •  1,  and  for  all  remaining  1  in  the  set 

jj . ^n-(p-l)’  ^fSi^  <  0  for  those  8.  such  that 

»  ij,  while  ffgj)  >  D  for  those  1  such  that  » 
lj-1.  Define  S^-  to  be  an  output  submanifold  if 
(fjjjJ^  »  0  for  all  £  such  that  «  l,  and  for  all  re¬ 
maining  t  in  the  set  . Jn-(p-l)*  (fbi}l  -  0  for 

those  l  such  that  i^  »  i^,  while  (fgj)t  >  for  those 
such  that  •  it-l.  Note  that  those  sets  for  which 
(fgj)g  t  0  when  6^  •  1  need  net  be  considered.  So  long 
as  th»  set  of  or  . -at  submani folds  of  Sfci  is  non-empty, 

Cgf  l*  assigned  the  set  of  all  values  f^  on  the  output 

submanifolds-  If  the  set  of  output  submanifolds  is  empty, 
Sbi  is  *  £«n*r»H *«*  sliding  surface.  Consider  f~r  on 

SjJJes|  in  the  input  set.  If  this  set  is  empty,  3et 
fbl  *  °-  Recall  that  Sgjes|  is  formed  by  keeping  i  un¬ 
changed  in  all  but  one  position,  say  jfc,  of  b,  so  b  « 
(bj,...,bj  j,  0,  bj^,j , . ..,bn)  and  either  I  •  i  or  i  « 

(i, . i,  1,  I,  Thus  there  are  a  maximum  of 

1  jv  V1  n 

l(n-Cp-l))  surfaces  in  this  subset  of  the  input  set. 

These  surfaces  ere  considered  in  pairs  to  determine  the 
admissable  values  of  f^;  using  the  example  above,  if 

3gt  is  in  the  input  set  then  (fgj)j  0  and  if  Sgv  is 

in  the  input  set  (frt).  *  0.  If  both  elements  are 
hi  ]l( 

members  of  the  input  set  then 

fbl  *  ^bi^bl  '  (fbi)jltfbll/[(fbi,jk  *  (fbi)jkI 


while  if  only  one  Is  in  the  input  set,  let 


are  2ero,  so  that  further  motion  occurs  on  itself. 

Thus,  the  procedure  for  extending  the  function  f 
to  ail  of  Rn  is  completed.  The  complexity  of  the  pro¬ 
cedure  arises  from  the  large  number  of  possibilities 
which  can  arise.  A  number  of  such  special  cases  are 
illustrated  on  Figure  2.  Evidently,  the  procedure  for 
extending  f  is  not  the  only  one  which  could  be  devised. 
Tn  the  next  step,  construction  of  solutions,  however, 
it  will  become  apparent  that  the  underlying  principle 
has  been  to  define  f  in  a  manner  which  preserves  ell 
trajectories  that  might  arise  from  each  initial  con¬ 
dition. 

n 

Let  xqcR  be  given  as  the  initial  condition  of 

(2.1)  at  t  *  t  ;  let  S..ES?  be  the  smallest  submani- 
o  bi  i 

fold  containing  x  .  Let  f.  .  denote  one  of  the  extended 

3  0  i 

values  of  f  on  S...  Define 

D1 


*  fbi(T-t.)  ;  <  r  <  tj 


The  time  t.  is  defined  as  follows;  for  each  2  such 

A 

that  (fbi)g  is  nonzero,  let  (tj)k  denote  the  first 
t  >  t  such  that  [$(T,t  ,x  )],  is  an  integer;  then  t.  • 

O  O  O  fc  1 

minlftjjj]  and  Xj  »  b(tj,to,xo).  If  fbi  •  0,  then 

t,  «  •  ind  x.  *  x  ,  and  this  solution  terminates.  Oth- 
1  10 

erwise,  x;  defines  new  values  of  b.i,  and  p,  and  the 
solution  process  continues: 

♦(T-V\)  *  xk  *  fbi(t*V  :  *k 4  T  i  Vi  iS-5) 


% 

y 

/ 

s 
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fbi*° 


The  set  of  possible  values  of  f  ,  on  a  generalized  slid- 

#1  . 

ing  mode  is  completed  by  considering  each  SgTCSt  in  this 


manner.  In  all  such  cases,  (£.,), 


1 . n-  (p-l) 


Figure  2 

Illustration  of  Nonuniqueness  of  Solutions 
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On  those  surfaces  where  ffa.  is  multivalued,  each  pos¬ 
sibility  must  be  examined  in  turn;  in  this  sense,  q 
is  also  multivalued.  Each  trajectory  pieced- together 
in  this  fashion  can  be  suasarized  by  a  sequence 
Cx1c,t)(),  k  «  0,1,...  in  some  cases,  these  sequences 

are  finite  and  in  other  cases  infinite.  By  inspection 
of  {xfc>  alone,  a  corresponding  sequence  of  regions 

{o^},  where  a^ejS^}  is  the  minimal  submanifold  con¬ 
taining  x^.  can  be  constructed. 

A  solution  of  (2.1),  (2.2)  is  then  defined  in  the 

obvious  manner,  as  any  <p(t,t  ,x  )  constructed  by  the 
0  0 

continuation  procedure  (3.3).  It  has  the  property  that 
for  any  finite  admissable  k,  $(t,to,xo)  is  piecewise 

continuous  on  [t0itwl-  This  solution  by  continuation 
is  said  to  be  asymptotic  if  1£«  t^  -  «.  An  asymptotic 

solution  is  piecewise  continuous.  For  purposes  of  the 
present  work,  a  solution  will  be  said  to  exist  if  the 
state-space  continuation  is  asymptotic.*  Asymptotic 
solutions  need  not  be  unique,  but  the  rate  of  growth 
in  the  number  of  solutions  can  be  bounded  as  a  function 
of  k,  since  the  maximum  number  of  output  submanifolds 
can  be  bounded  above  for  any  S^.  If  there  is  only 

one  asymptotic  solution  through  (xQ,to) ,  it  is  said  to 

be  unique.  Continuous  dependence  of  $(t,t  ,x  )  with 

0  o 

respect  to  xo>  of  course,  is  not  to  be  expected  for 


IV  Stability 


The  usual  definitions  of  stability  presuppose  a 
solution  which  is  well-posed  in  the  sense  of  existence, 
uniqueness,  and  continuous  dependence  on  the  initial 
data.  Diced  systems,  in  general,  do  not  possess  the 
last  two  properties.  One  alternative  is  to  neverthe¬ 
less  use  the  standard  notions  of  stability,  restrict¬ 
ing  their  domain  of  application  to  chose  initial  states 
for  which  the  usual  notions  of  well-posedness  are 
(locally)  satisfied.  Unfortunately,  the  set  of  such 
initial  states  appears  quite  difficult  to  characterize 
and  thus  imposes  an  awkward  restriction  on  the  appli¬ 
cability  of  this  alternative. 

Another  alternative,  introduced  here,  does  not 
impose  such  restrictions,  but  weakens  the  notion  of 
stability  that  is  employed.  Stability  is  viewed  as  a 
qualitative  property  of  a  trajectory,  and  a  system  is 
then  said  to  be  stable  when  all  of  its  trajectories 
share  this  property. 

Definition:  The  motion  of  a  diced  system  (2.1), 
(2.2)  initiated  at  (t  ,x  )  is 


••<(»„, x) 


iated  at  (t  fx  )  is 
o  o 

(9(t,t  ,x  ),  t  >  t 
0  0  —0 


0  is  a  transition 
function  initiated  at 
(t  ,x J} 


(a)  Bounded  in  magnitude  if  there  is  a  constant  d  >  0 
such  that 

max  (sup  ||*(t,t  ,x  ) ||)  <  * 

<M(t  ,x  )  t>t  0  ° 

0  o  —  o 

(b)  Bounded  in  cardinality  is  there  exists  a  constant 
N  such  that 

sup  (cardinality  of  M(t  ,x  ) )  <  N 

tn  °  0 

—  0 

The  concepts  of  boundedness  in  magnitude  and 
cardinality  are  independent.  In  both  cases,  the  only 
difficulties  occur  at  t-“»,  since  (a)  any  Wt-.t  ,x  )  is 

o  o 

by  construction  bounded  for  all  finite  t,  and  (b)  the 
cardinality  of  d>(t,tQ,xo)  is  finite,  by  construction, 

for  all  finite  t.  The  following  propositions  are  al¬ 
most  immediate. 

Proposition  1:  In  (2.1),  suppose  llfQill  <f  for 

all  i,  then  |  |*(t, t,xj  -  x  ||  <  F(t-t  )  for  all 
«e«{t  , x  ) .  0  °  °  0 

0  0 

Proof:  The  extension  of  f  .  to  f.  .  always  guar- 
-  ....  oi  bi 

anteed  that  I [f^ 1 1  <  F,  and  the  construction  procedure 

(3.3)  guaranteed  that  the  estimate  of  the  proposition 
held  for  each  t.  q.e.d. 


Proposition  2:  Let  |i|  -  |ij|*...*|i  |,  Suppose 

for  system  (2.1)  there  exists  B  >  0  such  that  for  all 
lil  >8,  and  k  «  l,...,n,  (fQi)k  i^  <  0.  Then 

M(to.xJ  is  bounded  in  magnitude. 

Proof:  For  any  i  such  that  |i|  >  B,  every  set 
Sj}i  contains  output  submanifolds  with  the  same  |i|  or 

smaller  111,  and  input  submanifolds  with  the  same  |i| 
or  larger  |i|;  further  more,  always  outputs  to  SQr 

with  |i|  <  |l|.  Thus  the  construction  process  cannot 
terminate  for  |i|  >  B,  and  for  such  i,  |i|  is  reduced 
at  least  once  every  n  intervals;  hence  every  solution 
satisfies  |d(t,to,xo)|  <  B  for  t  sufficiently  large. 

Thus  M(to>x0)  magnitude-bounded. 

Proposition  3:  Suppose  that  for  every  ieZn, 

JJ 

bEB'  .  !>  ^  has  at  most  one  output  submanifold.  Then  the 
motion  of  (2.1), (2. 2)  is  bounded  in  cardinality. 

Proof :  The  extension  procedure  of  Section  III 

shows  that  in  this  case  f.  .  takes  she  value  on  its  out- 
bi 

put  submanifold  nr  the  value  zero.  If  a  trajectory 
enters  S^,  it  either  continues  uniquely  to  the  output 

submanifold,  or  terminates  at  S.  ..  In  cither  case,  the 

bi 

cardinality  of  the  solution  cannot  increase  during  its 
construction. 

Thus  there  are  two  notions  of  instability  for 
bleed  systems:  solutions  may  become  unbounded  in  mag¬ 
nitude,  and/or  they  may  become  unbounded  in  cardinality. 
This  second  form  of  instability  is  new:.  a  trajectory 
can  fracture  and  a  chain  reaction  of  subsequent  frac¬ 
tures  nay  ensue  -the  complexity  ef  the  process  grows 
without  bound. 

.'.ext,  a  notion  of  stability  is  put  forth.  Suppose 

that  the  motion  M(t  ,x  )  of  a  diced  system  is  bounded 
o  o 

in  magnitude  ana  cardinality  (or  5 imply  “bounded’'). 


uJi*...*ii„i 


which  is  the  set  of  all  trajectories  originating  at 

rt  ,x  ) . 
o  o 

Definition:  The  motion  M(tQ,xo)  of  a  diced  sys¬ 
tem  is  said  to  be 


'Moreover  if  lim  t^  t  ■».  solutions  by  time-continuation 

could  bo  defined;  however,  their  properties  will  not 
be  explored  here. 


rhen  a  set  SC  Rn  consisting  of  a  finite  union  of  the 
submanifolds  is  termed  a  positive  limit  set  of  a 

(bounded)  trajectory  p(t,to,xo)  if  for  any  point  xeS, 
there  exists  a  sequence  of  times  },  tending  to  in. 
finity  as  k-~,  so  that 

lia  WVVV  -  x(  *  0  (4.1) 

where  )(  denotes  the  set -membership  metric,  i.e.,  if 
x£Sbi* 

)y-x(  ’  |  0  yeSbi 

In  applying  this  definition,  it  is  important  to  recall 
the  standing  assumption  from  Section  III,  that  all  tra¬ 
jectories  are  asymptotic,  so  that  such  sequences  {t,  } 
exist.  * 

Definition:  A  bounded  motion  M(t  ,x  )  of  a  diced 

-  O  O 

system  is  termed  pointwise  stable  if  all  trajectories 
J(t,to,xo)c  «(to,XQ)  have  the  same  positive  limit  set. 

The  motion  is  locally  stable  for  XgtS^  if  all  tra¬ 
jectories  <p(t,t  ,x)e  M(t  ,x),  xeS.  .,  have  the  same 

O  0  D1 

positive  limit  set.  The  motion  is  globally  stable  if 
all  trajectories  d(t,t  ,x)  have  the  same  positive 
limit  sot.  ° 

Concepts  of  uniform  stability  will  not  be  discus¬ 
sed  since  only  time-invariant  diced  systems  are  con¬ 
sidered  in  the  present  account.*  In  fact,  the  eval¬ 
uation  of  stability,  according  to  the  definitions  given, 
can  be  based  merely  on  knowledge  of  the  sequence 

of  submanifolds  containing  {xj,} ,  since  it  is  known 
fTom  the  construction  procedure  chat  t.  ,  >  t,  and  from 

I  K 

the  asymptotic  assumption  that  lim  t.  •  <*.  This  3ug- 

k_“ 

gests  that  a  way  to  generate  the  sequence  f  auton- 

mously,  without  explicit  integration  and  generation  of 
(x^.t^)  would  be  particularly  valuable  in  the  assess¬ 
ment  of  stability.  This  has  not  been  achieved  yet. 

knowledge  of  the  time- structure  (t^j  of  individual 

solutions  can  be  of  further  value  in  refining  stability 
notions.  To  simplify  the  remaining  concepts  it  is  now 
assumed  that  the  trajectories  are  uniquely-defined 
(e.g.,  as  occurs  in  Proposition  3)  and  bounded.  Sup¬ 
pose  II  is  a  positive  limit  set  of  such  a  solution  in 
the  conventional  sense  of  Section  II  (eq.  (2.5)).  Then 
in  the  usual  manner  it  can  be  shown  that  11  is  bounded, 
closed,  non-empty  and  invariant,  the  last  property  be¬ 
ing  a  consequence  of  time-invariance.  In  fact,  as  a 
consequence  of  finite-dimensionality  of  Rn,  all  such 
solutions  are  asymptotically  almost-periodic  [6],  Two 
cases  of  special  interest  are  the  asymptotically  con¬ 
stant  (equilibrium)  solution  and  the  asymptotically 
periodic  solution.  These  can  be  identified  directly 
from  the  sequence  (x.  ,t.)  charactcricir.g  ?(t,t  ,.\  ). 

K  K  0  0 


*The  results  could  be  extended  in  this  direction  for  sys¬ 
tems  with  continuous  time-variation;  however  discon- 
tinuously  time-varying  systems  may  not  be  continuable, 
as  Filippov  pointed  out. 


Proposition  4:  If  the  sequence  {x^.t^}  is  finite 

of  length  N,  the  positive-invariant  limit  set  consists 

of  one  point,  the  last  value  x„  (for  which  t„  «  «•) . 

N  N 

If  the  sequence  {x^ , }  is  jointly  periodic  of  period 

m  for  k  >  N,  then  the  positive-invariant  limit  set  is 
a  cycle  (closed  curve)  in  Rn. 

Proof:  For  the  first  case,  note  that  the  con¬ 
struction  procedure  automatically  defines  tN  »  -  when 

the  sequence  is  finite,  and  this  implies  a  constant 
solution  for  t  >  tf).  In  the  second  case,  note  that 

since  (x^.t^)  completely  specify  $(t,t0>xo),  $  must  be 

periodic  t^-t^,  fc  >  N,  whenever  (x^ . tk )  is  periodic 

(in  fact,  the  solution  is  a  linear  interpolation  be¬ 
tween  these  points). 

It  is  interesting  to  note  that  for  diced  systems, 
the  establishment  of  an  equilibrium  or  periodic  solution 
after  a  finite  time  (tN)  is  often  to  be  expected  (where¬ 
as  this  would  be  considered  exceptional  In  the  case  of 
continuous  differential  equations);  however,  in  some 
cases  almost  periodic  solutions  may  also  exist. 

V  Discussion  and  Conclusions 

The  present  account  of  the  stability  of  diced  sys¬ 
tems  leaves  a  number  of  questions  unanswered  and  raises 
some  new  ones.  A  study  of  methods  for  temporal  con¬ 
tinuation  of  non-asymptotic  solutions  is  needed;  such 
solutions  may  represent  a  new  sort  of  sliding  mode 
which  can  arise  in  higher  dimensional  spaces,  as  sug¬ 
gested  by  an  example  of  Utkin  [7] .  The  possibility  of 
extending  the  techniques  developed  here  to  time-varying 
systems  has  been  mentioned;  Filippov1*  general  existence 
results  apply  to  this  problem.  A  study  of  the  partition¬ 
ing  of  initial  states  which  is  implied  by  the  proposed 
stability  definition  would  also  be  fruitful;  what  prop¬ 
erties  are  shared  by  initial  state  sets  giving  rise  to 
the  same  asymptotic  solution?  In  general,  it  would 
appear  that  the  initial  states  within  a  given  region 
Sbi  can  ultimately  end  up  widely  dispersed.  The  pos¬ 
sibility  of  using  an  automaton  to  simplify  the  prop¬ 
agation  of  solutions  has  also  been  raised.  The  approx¬ 
imation  of  continuous  systems  by  diced  systems  has  not 
been  explored,  but  under  appropriate  conditions,  a 
bound  on  the  approximation  error  should  be  achievable. 

In  spite  of  the  questions  that  are  unanswered, 
some  modest  progress  has  been  made  toward  defining  the 
stability  properties  of  diced  systems.  First,  a  con¬ 
structive  continuation  procedure  for  higher  dimensions 
has  been  found;  the  problem  readily  evades  one's  intu¬ 
ition  above  n  =  1,2  and  even  3  as  endless  combinations 
of  difficult  situations  may  occur.  Second,  a  compromise 
on  the  issue  of  uniqueness  has  been  put  forth:  the  num¬ 
ber  of  admissable  solutions  at  any  finite  time  is 
bounded.  Third,  the  concepts  of  stability  have  been 
generalited  to  provide  meaningful  criteria  for  discon¬ 
tinuous  systems  of  diced  type. 

Returning  to  the  electric  power  system  example 
cited  in  the  opening  section,  it  would  appear  that  the 
implications  of  the  research  might  be  very  disturbing, 
for  two  primary  reasons.  First,  a  new  type  of  insta- 
bility--an  unbounded  growth  in  the  number  of  possible 
solutions  with  time--has  been  identified.  Second,  and 
independently,  the  partitioning  of  the  initial  state-- 
at  least  in  worst-case  situations--based  on  asymptotic 
properties,  appears  to  be  very  fine  and  irregular;  thus 
a  small  perturbation  in  the  initial  state  may  give  rise 
to  completely  different  asymptotic  behavior  than  is 
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found  for  tha  unperturbed  initial  state.  Both  of  these 
phenomena  iaply  that  the  future  behavior  of  a  diced 
systea  with  a  (approxiaately)  specified  initial  state 
aay  be  fundaaentally  unpredictable;  if  the  long-tern 
future  consequences  of  a  present  control  policy  are 
unpredictable,  the  problem  of  choosing  the  best  policy 
becoaes  aore  difficult  and  planning  aust  be  done  with 
a  shorter  horizon. 
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Abstract 

Asynchronous  multitask  processes  occur  in  a  wide  variety  of  control 
applications  ranging  from  industrial  control  to  computer  operating  systems, 
yet  no  analytical  methods  are  available  for  studying  their  detailed  behavior. 
The  preliminary  results  reported  here  illustrate  that  a  very  general  class 
of  such  processes  can  be  represented  by  discontinuous  hybrid-state  discrete¬ 
time  systems. 
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Scientific  Research  under  Contract  F49620-80-C-0002 .  The  results  presented 
here  do  not  necessarily  represent  the  views  of  the  U.S.  Government. 
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Eackground  and  Motivation 

A  multitask  process  is  characterized  by  a  number  of  tasks  which  operate 
concurrently  or  sequentially,  on  an  external  resource  or  data  base.  The 
timing  of  the  tasks  is  generally  asynchronous  in  that  new  task  execution 
is  initiated  by  the  completion  of  previous  tasks.  If  necessary,  synchrony 
and  sequential  ordering  of  tasks  can  be  enforced  in  a  number  of  ways  through 
the  task  definitions  themselves.  However  in  this  research  no  such  constraints 
are  imposed:  rather,  the  general  qualitative  behaviors  which  may  arise  in 
such  systems  are  analyzed.  Only  two  basic  assumptions  are  imposed:  (1)  a 
task  requires  a  finite  amount  of  time  and  storage  to  execute,  and  (2)  task 
descriptions  are  fixed,  in  that  the  execution  of  a  task  cannot  alter  its 
own  nature  nor  the  number  or  nature  of  any  other  tasks. 

The  range  of  possible  behavior  of  such  systems  is  so  large  that  the 
problem  of  conceptualizing,  analyzing  and  "debugging"  multitask  processes 
is  very  common  and  enormously  complex.  Two  approaches  are  presently  in 
use:  stochastic  queueing  analysis  [1],[2]  and  simulation  [3], [4].  Queue¬ 
ing  analysis  is  most  useful  for  evaluating  the  average  performance  properties 
of  an  operational  multitasking  system,  while  simulation  allows  certain  un¬ 
desirable  properties  of  a  planned  system  to  be  discovered  and  corrected 
during  the  design  process.  Neither  of  these  methods  provides  very  much 
insight  about  generic  problems  in  the  design  of  such  systems,  nor  do  they 
provide  ideas  about  how  to  remedy  or  detect  flaws.  The  results  reported 
here  constitute  a  modest  step  in  that  direction. 

Model  Development 

Let  te[t  ,<*>)  denote  time.  Three  sets  of  state  variables  will  be 
1  o 


identi f i ed : 


x*  -  those  states  which  vary  continuously  with  time  and  take  on  real 


values . 

x“  -  those  states  which  are  real-valued  but  change  only  at  discrete 
instants  of  time 

x3  -  those  states  which  are  discrete-valued  and  (necessarily)  change 

only  at  discrete  instants  of  time. 

12  3 

The  state  set  is  denoted  X  =  (X  ,X  ,X  }.  For  present  purposes,  it  will  be 

assumed  that  these  sub  sets  of  states  are  finite-dimensional  and  recognizable; 

an  example  will  be  provided  below.  Let  the  increasing  sequence  {t^ }  denote 

2 

the  set  of  all  values  of  t  for  which  changes  in  at  least  one  element  of  x 

or  x3  occur,  and  let  the  values  of  the  states  prior  to  and  following  t,  be 
.  +  .  +  k 

denoted  ,  respectively,  for  i  =  1,2,3.  In  the  sequel,  will  be 

identified  with  x^. 

The  instants  {t^}  will  be  identified  with  task  initiation  or  termination 

times.  Let  the  set  of  tasks  in  the  svstem  be  denoted  G  ={G,  ...G  }.  Associated 

1  n 

with  each  task  is  an  iniation  function,  a  termination  function  and  a  state- 
update  function* : 


gj:  X  -  {0,1} 

gj:  X  -  {0,1} 

f . :  X  -  X 
J 


initiation  function  for  task  j 
termination  function  for  task  j 
state-update  function  for  task  j 


Each  task  is  either  "on"  or  "off":  let  G  denote  those  tasks  which  are  "on" 

V  A  V  ~ 

and  G  denote  those  which  are  off,  so  that  G  =  G  U  G  and  GuG  =  4>  (the  null 

~  v/ 

set).  The  subscript  j  will  be  used  to  denote  tasks  which  are  "on"  and  i 


To  simplify  this  exposition,  these  3re  assumed  to  be  time-invariant;  how¬ 
ever,  this  assumption  may  be  relaxed. 
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to  denote  tasks  which  are  "off".  The  task  succession  rule  is  as  follows: 

A  transition  time,  t^>  is  declared  whenever 

112  3 

(a)  For  some  je{j},  g^  (x  ,x  ,x  )  undergoes  a  0-»-l  transition 


~  T  1  2  3 

(b)  For  some  je{j},  (x  ,x  ,x  )  undergoes  a  0-+1  transition 

Between  task  transition  times,  only  the  states  x^  can  change,  according  to 
a  state  equation 

•1  1  ?  +  3* 

x  (t)  =  f(x  (t),  x^,  x^  )  (1) 

with  x^(tjP  =  x^  .  At  the  completion  time  t^  of  a  task  j,  the  transformation 


=  f . 
J 


2-  2  3-  •  3 

is  applied,  with  x^  =  \  i  and  \  =  xk-i 

At  a  transition  time,  it  is  possible  that  more  than  one  task  terminates 
and/or  more  than  one  task  is  initiated.  This  produces  an  inherent  conflict 
situation  which  must  be  resolved  in  a  consistent  manner.  For  instance,  if 
tasks  and  terminate  together,  it  is  not  necessarily  true  that 
fjj  o  f^  =  f j 2  °  (functional  composition  may  not  be  commutative).  Or 
if  task  jj  is  initiated  when  j7  terminates,  then  up-dating  with  f^  may 
turn  off  jj,  while  terminating  may  turn  on  j,,  again,  etc.  In  this  pre¬ 
liminary  abstract,  it  will  be  assumed  that 

•  there  is  a  fixed  priority  among  task  completions  (e.g.  1  >  2  >  3  > 
j  >  . . .>  n) 
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•  all  completions  are  performed  first  according  to  priority,  3nd  then 
initiation  functions  are  re-evaluated  to  redetermine  which  tasks  (if 
any)  should  be  initiated  at  the  transition  times. 

Other  conflict-resolution  methods,  such  as  imposed  sequential  orderings,  are 
also  possible. 

a.  n  + 

Let  j^e  2  be  the  set  of  tasks  active  at  t^.  Let  the  transition  map¬ 
ping  of  (1)  be  given  by  p  [0,o°)x  X1  -+-X1,  so  that  the  solution  of 

x*(t)  =  ffx1,^,^)  ;  x1(tk)  =  x£  (3) 


is 


x:(t)  =  <Kt-tk,xJ; 


(4) 


where  x^.x^  are  viewed  as  parameters.  Define  the  function  r:  2n  x  X  +  R+ 

A 

to  be  the  first  transit ion- time  encountered  with  processes  j  c2  active  at 

12  3 

t  =  tQ,  with  initial  state  x  *  (x  ,x  ,x  )eX.  This  can  be  tabulated  by 
integrating  (1)  and  applying  rules  (a)  and  (b) .  Let  the  function 
a:  2n  x  X  +  2n  define  the  next  set  of  active  tasks,  determined  from  the 


preceding  priority  rules,  at  the  transition  time  defined  by 
words , 

Vl  =  h  +  T(jk’xk’xk'xk) 


In  other 


3 


k  +  1 


~  12  3 

(WVV 


(5) 

(6) 


The  important  point  to  observe  is  that,  in  principle,  it  is  not  necessary 

to  include  the  continuous-time  part  of  the  dynamics,  since  t  and  a  can  be 

I  T 

pre-computed  from  f,  {gj},  and  (g^K 

In  summary,  the  dynamics  of  the  asynchonous  multitask  system  can  always 


be  represented  in  the  form 
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t 


k+1 


Vi 

^k+1 


\  *  r(vV  ) 
fJ  (V 

J  k 

A 


(7) 


where  f?  is  the  composition,  according  to  priority,  of  the  transition 

h 

functions  (2)  of  the  tasks  completing  at  t^j-  It  is  then  clear  that  t^.+j 

12  3 

may  be  combined  with  x  and  x  ,  and  that  x  may  be  combined  with  j  to  yield 

a  general  discontinuous  hybrid  discrete-time  system.  Extensions  to  stochastic 

I  T 

behavior  of  f,  {f^},  {g^}  and  {gj }  are  readily  accomodated. 


Qualitative  Properties 

The  finite-state  part  of  (7)  may  be  further  aggregated  to  produce  an 

equivalent  real-state  discrete-time  system  with  discontinuous  transition 

function.  Systems  of  this  general  class  have  been  discussed  by  Johnson  [5] 

and  Kaliski  and  Lemone  [6],  Their  behavior  may  roughly  approximate  the 

behavior  of  discontinuous  systems  discussed  in  Utkin  [7]  and  Johnson  [8]. 

The  pertinent  properties  of  such  systems  will  be  described  more  fully  in  the 

final  version  of  this  paper.  Here  it  is  merely  noted  that  problems  may 

arise  if  lim  t,  is  finite.  A  possible  behavior  in  this  situation  is  an 
k-*°°  K 

approximation  to  sliding  mode  behavior,  which  is  closely  akin  to  the 
phenomenon  of  "thrashing”  observed  in  heavily- loaded  multitasking  systems. 


Examples 

Realistic  examples  will  be  provided  in  the  conference  version  of  this 


paper. 


I 
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Multitask  Control  of  Distributed  Processes 
T.L.  Johnson* 

Abstract 

As  one  class  of  real-time  operating  system,  multitask 
systems  are  widely  used  in  distributed  process  control 
applications.  The  evolution  of  tasks  in  such  systems  may  depend 
on  the  dynamic  response  of  the  controlled  process  and  on  task 
completion  times.  Under  certain  assumptions,  it  is  shown  that 
the  dynamic  evolution  of  such  feedback  systems  can  be  modelled 
by  a  finite-dimensional  discrete-time  hybrid-state  dynamic 
system.  An  example  of  a  thermal  control  system  is  given. 
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I.  Introduction 

The  design  of  real-time  computer  control  systems  for 
distributed  processes  has  been  hampered  by  the  lack  of  adequate 
analysis  tools.  Since  the  evolution  of  state  in  such  systems 
depends  on  the  timing  of  process  events  as  well  as  computing 
tasks  (and  not  just  the  sequence  of  completed  tasks) ,  conventional 
finite-state  or  differential-equation  models  are  inadequate  to 
predict  details  of  task  coordination  and  sequencing  which  are 
critical  for  design  purposes.  For  multitask  systems,  a  class 
of  hybrid-state  discrete-time  models  is  shown  to  be  applicable 
to  this  problem;  other  real-time  operating  systems  may  require 
more  general  models  (Gonzalez,  1977). 

Even  for  relatively  simple  systems,  the  analysis  of  timing 
is  complex.  An  example  of  a  furnace  temperature  controller 
with  overheat  protection  is  given  to  illustrate  this  fact. 

Qualitative  properties  of  hybrid  systems  of  this  class 
have  been  studied  in  Sontag  (1981),  Johnson  (1980).  Some 
design  methods  are  described  in  Vidal  (1969)  .  General  controller 
synthesis  methods  are  not  yet  available  for  such  systems. 
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The  transition  between  tasks  may  depend  on  the  values  of 

continuous  or  discrete  process  variables,  and  it  is  the  dynamics 

of  the  joint  process  that  is  of  interest.  Let  te (t  ,“)  denote 

time.  The  state  set  X=(X1,X2}  is  the  product  space  of  X1= 

{those  states  which  are  discrete-valued,  including  all  discrete 

memory  states),  and  X  =  (those  states  which  vary  continuously 

with  time  and  take  on  real  values).  Let  the  set  of  tasks  in 

the  system  be  denoted  G=(G1 , . . . ,G  ) .  Associated  with  each  task 

is  a  task  initiation  function  g3:  X-*-(0,l),a  task  termination 

function  g..  :  X^(0,l),  and  a  state  update  function  f ..  iXxX^X. 

Each  task  is  either  "on",  or  "off".  Let  q'*‘={q^ ,..  .q3-)  e2n  denote 

those  tasks  which  are  "on",  i.e.,  q^=l  when  task  j  is  "on", 

q.=0  when  it  is  "off".  A  task  transition  time,  tv,  is  declared 
J  K 

whenever 

n  I  -1  \  n  T  1 

T=[V  (gjAqt)  ]V[V  (gjAq!) J  (1) 

j-1  33  j=l  3  3 

makes  a  Q-*-l  transition,  i.e.,  an  inactive  task  is  initiated  or 

an  active  task  is  terminated.  Between  task  transition  times, 

the  states  in  X3"  are  assumed  to  be  constant*,  and  the  states 
2 

m  X  are  assumed  to  evolve  according  to  a  time-invariant 
differential  equation 

x2(t)  =  f (x2 (t) ,x1 (tK) )  tE^tk,tk+l)  *2) 

2 

wnere  f  is  assumed  to  be  uniformly  Lipschitz  continuous  on  X 
for  each  x^cx3-.  Let  i> :  [0,":)x  X-'-X  be  the  transition  mapping 

of  (2),  defined  for  each  x3;X3,  such  that  the  solution  of  (2) 
with  initial  data  xj^x3-  ( t^)  ,  x2  =  x2  ( t^)  is 
* 

This  assumption  can  be  relaxed  by  introducing  additional 
transition  times  for  spontaneous  discrete-state  transitions, 
if  desired.  The  assumption  is  satisfied,  for  instance,  when  there 
are  no  discrete-state  memory  devices  external  to  the  computer 
memory,  and  when  only  the  task  scheduler  is  allowed  to  change 
the  memory  states  x1. 


The  task  state-update  functions  f ^  must  thus  take  as  their 

arguments  the  state  at  time  of  task  initiation  and  at  time  of 

task  completion;  these  functions  are  composed  with  one  another  in 

order  of  completion  priority*.  The  convention  q^-  (q^  ,q k  )  , 

1  2 

x^=(x^  ,  x^  )’  has  been  used  m  (6).  Rephrasing  (4)- (5)  and 
defining  the  state  of  the  combined  process  as 

n1 (xk) 


x  = 


k+1 


a(xk5  I  (7) 

n2<V 

12  .  12 
where  n  and  n  denote  the  projection  of  n  onto  X  and  X  , 

respectively,  and  the  arguments  of  n»o  and  t  appear  as  subsets  of 

the  elements  xk#  respectively. 

The  well-posedness  of  this  model  depends  on  existence  and 

uniqueness  of  solutions  to  (2) ,  for  which  sufficient  conditions 

have  been  stated,  and  also  on  the  property  lim  t  =*>.  In  some  cases, 

K  K 

this  limit  may  be  achieved  for  finite  k,  which  is  acceptable;  in 

others,  limt,  may  be  finite,  which  is  not.  The  latter  case  may 
k-"<» 

be  prevented  by  placing  a  positive  lower  bound  on  the  range  of 
the  function  (e.g.,  related  to  the  cycle  time  of  task  scheduler). 


Ill .  Example 

The  temperature  control  of  a  room  by  a  furnace  which  is 
subject  to  overheating  is  considered.  The  room  is  equipped  with 
a  temperature  sensor  and  the  combustion  chamber  is  equipped  with 


The  definition  of  "priority"  is  a  question  of  semantics;  the 
task  which  has  highest  termination  priority  may  have  its  results 
overwritten  by  lower-priority  tasks  which  complete  afterward, 
according  to  the  convention  adopted  here. 
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sequencing  of  tasks  alternate  between  j=l  and  j  =  2,  but  the 
sequences  j=l,2,3  and  j  =  l,3  are  also  possible,  depending  on  the 
parameters  of  the  continuous  system.  Since  the  task  computations 
are  so  simple,  it  is  assumed  in  this  example  that  they  are 
completed  instantaneously. 

Suppose  that  the  dynamics  of  the  room  temperature,  R, 
are  given  by 

R=-aiR+3iF+6i  (8) 

where 


=  inverse  of  room  thermal  time  constant  (min.) 

6^  *  heat  capacity  of  furnace 

6^  =  constant  depending  on  ambient  temperature 
The  dynamics  of  the  combustion  chamber  temperature,  C,  are 
given  by 


C  =  -a  2^+3  2f+,5  2 

where 


(9) 


a_  =  inverse  of  combustion  chamber  thermal  time  constant 
(min . ) 

3 2  =  heat  capacity  of  combustion  process 

<5  2  =  constant  depending  on  ambient  temperature. 

Obviously,  more  complex  distributed-parameter  or  nonlinear 
radiation  models  could  be  chosen  in  place  of  (8)- (9).  The  room- 
temperature  setpoint  is  denoted  by  R  (implemented  in  the 
computer) ,  while  the  overheat  setpoint  is  denoted  by  C.  Define 


the  threshold  function 
1  x^x 
l  0  x  <  x 


QX(X)  =  ! 


(10) 


The  dynamics  of  the  timers  are  given  by 


-7 


In  order  to  define  the  functions  x  and  Oj(eq.(3),  (4))  of  the 

model,  note  that  the  transition  function  for  (8)  can  be  written 

-a  i  (t-t.  ) 

R(t)  =  [(61+81F)/a1]+e  x  *  [R(  tfc)  -  (6  (17) 

and  an  analogous  expression  is  obtained  for  C(t). 

Since  all  tasks  complete  in  zero  time,  it  may  be  assumed 
that  q^={000}  in  (4).  Suppose  that  F=0.  Then  only  Task  1  can 
be  initiated  next,  and  the  time  for  this  to  occur  is 


x 


(0,0, x2 


where 


D 


o 


T1AT2=1,  M=0 
t1at2=i,  M=1 

T1AT2=0,  m=o 
t1AT2=0,  M=1 


(18) 


(19) 


is  the  time  for  room  temperature,  R,  to  cool  to  R  if  R> R,  found 
from  (17)  . 

If  F=l,  then  either  Task  2  or  Task  3  may  occur  first, 

depending  on  the  parameters  of  the  problem  and  the  value  of 

2 

the  states  R  and  C  in  x  (since  T1=0,T2=0  are  required  when  F=l) . 
The  time  for  R  to  reach  R  when  R<^R<_(6^+8^) /a^  is 


D 


2 


(1/a^) In 


-R-(51+31)/a1- 
R-  (61  +  i1)/a1 


And  the  time  for  C  to  reach  C  when  C<C<_(62+82)/al2  is 


(20) 


D 


3 


(l/&2) !n 


C-  [6  2+2  2 )  /"x2~ 
C-  ( 6  2+^.  2 )  /  x  2 
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(21) 


r*-w* 


In  this  case,  the  order  of  invoking  the  tasks  is  immaterial  so 
that  (6)  does  not  depend  on  task  priority.  Mutual  exclusion  of 
the  tasks  could  be  represented,  if  desired,  by  modifying  the 
state  x1  to  include  status  information  corresponding  to  q^. 

In  addition  to  illustrating  the  application  of  this  modelling 
procedure,  the  example  has  been  concoted  to  illustrate  the 
versatility  of  conditions  which  can  be  represented  by  the  multitask 
formalism. 

IV.  Conclusion 

The  salient  assumptions  of  this  modelling  procedure  are: 

(1)  the  number  of  tasks  is  fixed  and  finite,  (2)  tasks  cannot 
modify  their  own  computations,  (3)  bounds  on  completion  times 
of  each  task  are  known,  (4)  tasks  are  assigned  fixed  priorities, 

(5)  the  time  scale  of  the  task  scheduler  is  much  faster  than 
the  process  time  scale  of  interest  in  the  model.  While  many 
multitasking  systems  are  conceptualized  in  a  more  general  manner 
which  violates  one  or  more  of  these  assumptions,  it  is  often 
possible  (with  some  inconvenience)  to  represent  them  in  a  form 
which  satisfies  these  constraints  through  appropriate  choice  of 
state  variables. 

Finally,  an  important  objective  of  this  paper  is  to 
illustrate  conclusively  that  traditional  infinite-dimensional 
continuous  process  control  systems  are  very  inadequate  for  the 
representation  of  typical  computer-controlled  processes,  and 
that  substantial  further  research  in  this  area  is  required. 
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ON  FEEDBACK  LAWS  FOR  ROBOTIC  SYSTEMS 
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Cambridge,  Massachusetts 

and 

Lecturer,  Dept,  of  Electrical  Engineering  &  Computer  Science1 
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INTRODUCTION 

A  variety  of  control  problems  arising  from 
robotics  applications  can  be  reseated  as 
optimal  control  problems  of  minimum- time 
state  transfer  in  the  presence  of  state-space 
constraints  and  constraints  of  Incomplete- 
state  Information.  The  traditional  approach¬ 
es  to  solving  such  problems  are  Fontryagln's 
Maximum  Principle  (Pontryagln  et.al.,  1962), 

In  the  case  of  open- loop  control,  and 
Bellman's  Dynamic  Programming  method  (Bell¬ 
man,  1957).  While  a  number  of  technical 
difficulties  exist,  approximate  solutions  of 
such  problems  can  generally  be  computed  off¬ 
line  (see  Kahn  and  Roth,  1971).  Perturbation 
methods  for  obtaining  local  feedback  laws  are 
also  available  (Whitney,  1972,  Hemaal,  1980). 

However,  no  currently  operational  robots  are 
known  to  be  based  on  solutions  of  such  optimal 
control  problems,  nor  is  it  likely  that  this 
will  come  about.  Some  of  the  reasons  for 
this  situation  can  be  given:  (a)  complete 
equations  of  motion  are  extremely  complex,  and 
are  often  not  avsilable;  (b)  trajectories 
must  usually  be  planned  in  a  short  time-period 
preceding  execution— there  is  no  time  for 
detailed  design  studies  or  numerical  analysis 
for  every  motion  being  performed;  (c)  relia¬ 
bility  and  repeatability  or  accuracy  of  motion 
are  often  more  Important  than  minimizing 
execution  time;  (d)  optimal  control  laws 
often  require  too  much  storage  or  real-time 
computation  during  execution  of  the  motion; 

(e)  nonlinearities  are  often  sufficiently 
severe  chat  local  linearization  gives  poor 
results  (even  If  Its  heavy  computational  re¬ 
quirements  are  overlooked) . 

By  contrast,  current  practice  Is  often  to 
determine  a  feasible  open-loop  position 


^Portions  of  this  research  have  been  performed 
at  the  MIT  Laboratory  for  Information  and  Dec¬ 
ision  Systems  with  support  provided  by  the 
U.S.  Air  Force  Office  of  Scientific  Research 
under  Contract  Ho.  F49620-80-C-0002. 


trajectory  by  a  "teaching"  procedure  (e.g. , 
Onimatlon,  Inc. ,  1979) .  The  trajectory 
recorded  during  this  procedure  Is  then 
"played-back”  as  a  sequence  of  position  com¬ 
mands  to  Joints  which  are  servo-actuated;  the 
rate  of  playback  may  be  Increased  In  a 
sequence  of  preliminary  trials,  until  the 
bandwidth  or  power  limitations  of  the  servos 
are  encountered.  This  methodology  Is  relativ¬ 
ely  quick.  Intuitive,  and  yields  reliable 
performance  when  the  disturbances  to  the 
robot  and  workspace  are  relatively  small. 
Although  this  state-of-the-art  approach  to 
trajectory  formation  Is  very  effective.  It 
possesses  Inherent  limitations  and  Is  already 
being  superceded  In  more  demanding  applica¬ 
tions  such  as  locomotion  and  manipulation. 

One  limitation  Is  that  a  human  controller 
cannot  readily  coaaaunlcate  commands  to  such  a 
robot.  The  robot  Is  also  unable  to  anticipate 
or  accoanodate  unexpected  changes  In  work¬ 
space  configuration;  the  teaching  paradigm 
cannot  be  readily  extended  to  allow  for  feed¬ 
back  from  additional  sensors  (e.g.,  touch  or 
machine  vision).  The  objective  of  the  present 
note  is  to  extend  and  affirm  the  suggestion 
of  Young  (1978)  that  discontinuous  feedback 
laws  are  naturally-suited  to  robotics  problems, 
to  describe  two  further  examples  of  discontin¬ 
uous  feedback  laws,  and  to  explore  further 
notions  for  the  synthesis  of  such  systems. 

Rationale  for  Discontinuous  Feedback  Laws 

Accepting  the  fact  that  optimal  feedback  laws 
for  this  class  of  problems  generlcally  exhibit 
discontinuous  behavior  (Athans  and  Falb,  1966. 
Kahn  and  Roth,  1971),  one  la  motivated  to 
seek  simpler  methods  of  determining  loci  of 
discontinuity.  The  theory  of  variable- 
structure  controllers,  developed  originally 
by  Emel'yanov  (1967)  and  extended  by  his 
colleagues  (see  Utkin,  1978)  has  provided  new 
design  methods  for  certain  classes  of  systems; 
It  Is  a  remarkable  observation  that  the 
performance  of  such  systems  can  be  qualita¬ 
tively  quite  robust,  even  though  their  pre¬ 
cise  trajectories  may  depend  strongly  on  the 
Initial  state,  disturbances,  or  modelling 
errors  (Young,  1978) . 


Iiun  LI  ummvmmimmjmmmjmm 


The  author  has  previously  suggested  (Johnson, 
1978)  that  there  is  a  close  relationship  of 
this  theory  and  the  theory  of  control  laws 
described  in  linguistic  terms,  e.g.,  as  a 
digital  computer  program  (Zadeh,  1973). 

Example  1,  in  the  sequel,  exhibits  this  rela¬ 
tionship.  Discontinuous  control  in  robotics 
applications  can  thus  arise  from  the  nature 
of  the  task  description  as  well  as  from  dis¬ 
continuities  in  the  mechanical  system  and 
environment,  as  illustrated  by  Example  2.  A 
third  reason  for  developing  discontinuous 
controls  arises  from  implementation  considera¬ 
tions.  Discrete  sensors  and  actuators  are 
usually  cheaper  and  more  reliable  than  con¬ 
tinuous  ones;  they  arise  naturally  in  discon¬ 
tinuous  control  law  synthesis.  Discrete 
signals  are  also  preferred  for  signalling 
task  initiation,  completion,  or  interrupts  to 
a  control  computer.  Finally,  digital  comput¬ 
ers  typically  perform  binary  operations  faster 
than  (approximations  to)  real  number  opera¬ 
tions. 

The  following  two  examples  illustrate  the  use 
discrete  feedback  control  in  two  very  simpli¬ 
fied  problems  arising  in  robotics,  which  lie 
just  beyond  the  current  state-of-the-art. 

Since  a  general  design  theory  for  such  cases 
is  not  yet  available,  each  example  is  solved 
on  its  own  merits. 


Suppose  that  t^  is  the  first  time  of  contact 

between  ball  and  hand,  and  let  t1  denote  a 

time  just  prior  to  t^  while  t^  denotes  a  time 

just  after  t, .  Assuming  fu(t)  is  approximately 
*  -  + 

constant  on  the  interval  (t^O,  it  can  be 

set  to  zero  without  affecting  the  conclusions 
of  the  following  analysis;  this  is  done  for 
simplicity  in  the  sequel.  Either  an  elastic 
or  inelastic  collision  may  occur  at  t^.  If  an 

inelastic  collision  occurs,  and  the  ball  is 
caught,  the  combined  dynamics  for  t>t^  are 

(M+mjz^j  »  -(Mem)g  +  f^(t) ;  ^(t)  =  *B(t), 


w 


*M1 


ml* 


the 


^1 

location  of 
impact 
(3) 


If  an  elastic  collision  occurs,  then 
mz  *  -mg,  z  (t,)  -  z_, ;  z_(t,)  *  ? 

B  B  i.  ml  B  1 

-Mg  +  fj(t)  5  *<«!>  "  «M1  "  *ml{ 


W 


(4) 


Example  1:  Catching  a  BalJ 

In  this  example,  the  "hand"  is  idealized  as 
a  cup-shaped  weight  of  mass  M  vhlch  can  be 
acted  on  by  vertical  and  horizontal  forces  in 
order  to  catch  a  (vertically)  falling  ball  of 
mass  m.  First,  it  is  assumed  that  the  hand  is 
beneath  the  ball  and  the  interception  dynamics 
are  analyzed.  Then,  a  simple  control  law  to 
achieve  catching  from  an  arbitrary  initial 
position,  using  remote  sensing  of  the  position 
of  the  ball  (a  primitive  form  of  vision),  Is 
given  in  algorithmic  form. 

The  geometry  of  the  problem  is  shown  in  Figure 
1.  Suppose  that  *B(t)  *  Xg(t)  “  0  to  analyze 

the  catching  process.  According  to  Newtonian 
mechanics,  the  bell's  motion  is  given  approxi¬ 
mately^  by 

mi  -  -mg  ;  z(t)  -  z  ;  i(t)-0  (1) 

B  BO  BO  B  O 

where  g  is  the  acceleration  due  to  gravity  and 
z  is  the  Initial  position  of  the  ball  at  t  , 

the  tlma  it  is  dropped.  The  motion  of  the 
hand  is  given  by 

*  fz(t):  *M(V  '  *Mo’  W"0 

(2) 

where  f  (t)  represents  the  control  force. 


2In  air,  a  viscous  drag  force  depending  on 
cross-sectional  area  is  also  present,  and 
could  be  used  in  estimating  the  ball’s  mass. 
This  digression  is  not  pursued  here. 


Conservation  of  energy  and  momentum  can  be 
Invoked  (now  taking  f  (t)-0)  in  order  to 
deduce  which  of  thesezsituatlons  will  occur, 
and  to  find  the  missing  velocites  at  t*^- 

Conservation  of  momentum  is 

F  i  mzm(t”)  +  KzB(t‘)  -  mijt*)  + 

(5) 

while  conservation  of  energy  (omitting  potential 
energy,  which  is  approximately  constant,  from 
both  sides  of  the  equation)  is 

E  :  Bim(ti)2  +  MzM(tl)2  ”  BZm(tl)2  + 

«> 

Viewing  these  as  simultaneous  equations  for 

z  (t*)  and  i^t^),  bouncing  is  predicted  when 
a  *  "  l  ^  ^  i 

there  is  a  solution  with  z,>(t^)>zM(tj)  . 

A  simultaneous  solution  yields  the  possibili¬ 
ties 

e  +  7  1/7 

z  (O  •  {P+(mH(E(Mfm)-Pz)  l*’*}  /m(M+m)  (7) 

B  1 

As  a  special  case,  suppose  that  z^U^)*!),  i.e., 

the  hand  Is  at  rest  at  the  time  of  Impact. 

Then  it  can  be  shown  that  a  real-valued 
solution  of  (7)  always  exists  and  that 


^Otherwise,  in  an  inelastic  collision,  energy 
dlaslpatlon  will  occur  at  t^  so  that  the  physi¬ 
cally  realizable  solution  zB(t*)  *  *jj(tj) 
about.  This  is  not  explored  further  here. 


comes 


UNTIL  z  (t)  <  z-.it)  +  E 


Thus  bouncing  will  occur  whenever  M>m,  which 
is  typically  the  case.  A  further  analysis 
shows  thac  if  M^,  a  finite  negative  velocity 
of  the  hand  prior  to  impact  (z^t^)*!))  will 

prevent  bouncing;  in  the  Unit  0*0,2^  (t”)  = 

z  (t,),  i.e. ,  perfect  tracking  will  be  re- 
tt  1 

quired;  if  the  ball  is  very  heavy  (m>M) ,  or 
has  a  very  large  velocity  at  impact ,  then  a 
catch  can  be  made  even  if  i^ft^)  is  positive, 

i.e.,  if  the  hand  comes  to  meet  it.  Typically, 
one  expects  m<M  but  not  m<<  M,  so  that  a  very 
small  movement  to  produce  a  slightly  negative 
hand  velocity  prior  to  impact  will  ensure  a 
successful  catch. 

In  a  catch,  the  hand  must  merely  intercept 
the  ball's  predicted  trajectory  before  the 
ball  arrives  at  the  point  of  interception, 
and  then  wait  to  make  a  small  final  maneuver 
to  avoid  bouncing.  If  the  ball  la  to  be 
struck,  (say,  in  the  x-directlon)  quite  a 
different  strategy  is  required:  The  ball's 
trajectory  must  be  Intercepted  precisely  at 
the  time  the  ball  reaches  the  interception 
point,  with  a  velocity  which  is  approximately 
perpendicular  to  the  trajectory. 

Now  suppose  thac  the  ball's  position,  x  (t), 

IB 

z  (t)  can  be  measured,  that  the  hand  position 

m 

^(t),  z^ft)  la  available  from  internal  meas¬ 
urement,  and  that  forces  f^(t)  and  f ^ ( t)  can 

be  applied  Independently.  Assume  that  accur¬ 
ate  velocity  estimates  can  be  obtained  from 
the  position  measurements.  At  t-t^,  the 

initial  time,  suppose  z  (t  )-z  ,  x  (t  )-0, 

si  o  mo  ta  o 

while  *B(t0>  -  *Mo<V*M(to)  ’  *Mo‘  A 
simple  implementation  of  the  rendezvous 
strategy  for  catching  the  ball  la  the  follow¬ 
ing  pseudo-Pascal  algorithm: 

PROCEDURE  CATCH 

BEGIN 

REPEAT 

fz(t)  -  0 


ex (t)  -  x[1(t)-x>(t) 


-Kxl**(t) 


UNTIL  |  e^ft) | cE^ 


fzM(t)  •  -K;(zM(t)-*B(t)> 
ex(t)  •  xM(t)-x>(t) 

1^  -  i  +  U^it) 

[A  is  the  sampling  Interval] 


f. (t)  -  -El 


IF  |  zM(t)-zn(t)li  Ez  AND  I  xM(t)-xm(t)li  E^ 
THEN  RETURN 

ELSE  [MISSED  THE  BALL,  GO  TO  ERROR 
RECOVERY  1 


The  first  REPEAT  loop  uses  position  feedback 
on  the  x-posltlon  error  (Intended  with  a 
"large”  gain  K^)  to  bring  the  hand  below 

the  ball  as  fast  as  possible.  The  second 
REPEAT  loop  uses  integral  control  on  Che 
x-error  to  more  accurately  position  the  hand 
below  the  ball,  and  derivative  feedback  on 
the  z-velocity  error  (Intended  with  a  "small" 
gain,  K^)  so  that  the  hand  has  a  small  down¬ 
ward  velocity  when  the  ball  strikes  it. 
Although  the  details  of  this  control  law  are 
essentially  irrelevant,  it  is  primarily  in¬ 
tended  to  illustrate  two  points:  (a)  it  is 
not  necessary  to  explicitly  predict  the  traj¬ 
ectory  of  the  ball  (I.e.,  to  preplan  the 
trajectory)  or  to  know  che  precise  mass  of 
the  ball;  (b)  The  control  strategy  is  dis¬ 
continuous  at  the  time  between  Che  two 
REPEAT  loops,  which  is  determined  by  the 
motion  of  the  ball  Itself.  In  the  second 
example,  the  control  law  discontinuity  arises 
primarily  from  scace-var iable  constraints 
rather  than  from  the  task  description. 

Example  2:  Converting  Vertical  Force  to 
Horizontal  Locomotion 

A  single  massless  link  of  length  terminated 
at  the  upper  end  by  a  mass  and  at  the  lower 
end  by  a  mass  aQ,  is  considered  in  che  example 

(Figure  2).  A  vertical  force,  F(t),  may  be 
applied  to  the  upper  mass:  When  this  force 
lifts  the  link  above  a  horizontal  surface  at 
z«0,  it  is  free  to  swing  back  and  forth  in 
one  direction  (defined  as  the  x-directlon); 
when  mess  m^  is  in  contact  with  the  surface. 

it  "sticks"  unless  an  upward  vertical  force 
component  is  subsequently  applied  co  it.  This 
assumption  approximates  the  effect  of  a 
friction  contact  between  m^  and  the  surface. 

The  intriguing  feature  of  this  example  is 
that  there  exist  simple  strategies  whereby 
the  purely  vertical  force  F(t)  can  be  used  to 
propel  the  link  in  a  forward  horizontal 
motion.  These  result  from  a  proper  combina¬ 
tion  of  two  motions: 

F:  The  link  falls  down  (like  an  inverted 
pendulum)  when  m^  is  on  the  surface  and 

no  vertical  force  is  applied  (F(t)»0). 

S;  The  link  swings  back  and  forth  in  a  stable 
pendulum  motion  when  m^  is  off  the  surf¬ 
ace  and  a  vertical  force  is  applied  to 
counteract  gravity  )z) . 


I 


The  equations  of  motion  are  first  derived 
In  the  two  cases  where  mQ  Is  not  In  contact 
with  the  surface  z-0  (Case  S),  and  then  when 
It  Is  In  contact  (Case  F) . 


Case  S : 


Let  Fq,  denote  the  force  on 


exerted  through  the  link  by  ,  and  F^g 
denote  the  force  on  m^  exerted  by  <Zg,  defined 

in  che  direction  of  the  link  for  each  mass . 
Newton's  equations  for  are 

Vo  "  •"o*+poi*ineo  <9) 

Vo  *  Foico,eo  (10) 

And  for  m^  they  are 


Vi  *  F 


V  ■  Fioalneo 


Vi  -  -Fioc08eo  (12) 

where  g  denotes  the  acceleration  due  to 
gravity.  The  constraint  of  equal  and  oppo¬ 
site  reactions  (rigid  link)  Is  Fg^F^g.  The 

link  Imposes  constraints  between  (Xg,Zg)  and 
(x^.z^)  which  are  moat  readily  expressed  In 
terms  of  0Q: 

xi  *  xo  +  V°86o  (13) 


Z1  •  zo  +  V^o  (14) 

The  clme-derlvatlvea  of  the  constraints  are 
us ed  because  the  constraints  must  hold  at 
each  Instant  of  time.  Elementary  algebra 
and  trigonometry  can  be  used  to  solve  for 
Fq1  and  In  (9)  and  (10).  Farther 

algebra  yields  the  key  equation  for  9g : 

90  •  Fcos90/b1£0  <15) 

In  this  example  It  Is  natural  to  assume  that 
Inertial  measurements  could  be  made  only  on 
m^,  and  thus  It  Is  of  interest  to  have 

equations  of  motion  directly  In  terms  of  the 
lnertially  measured  states  (x^,s^)  rather 

than  (Xg.Zg).  These  equations  ara: 

*1  *  '(aoV°VV)co,eoeo2  ' 

(m0/m1(m0+m1))sin90cos80F  (16) 

zi  ’  *Vo/W),ln9o®o2  '  * 

>[co82e0/a1+sln290/(n0-hi1)]F  (17) 

Purely  algebraic  constraints  (13)-(14)  can  be 
used  to  find  (Xg,Zg)  and  to  check  that 

Zq^;  otherwise  s  transition  to  Casa  F  may 

occur.  Furthermore,  note  that  (16),  the  fore¬ 
word  acceleration  of  a^,  Is  driven  by  the 

vertical  force  F,  providing  the  possibility 
of  locomotion. 


Case  F:  Let  F^  and  F^g  be  defined  as  in 

Case  S.  During  Case  F,  It  is  assumed  that 
(Xq,Zq)  remain  fixed  at  their  Initial  values, 

and  that  Zg*0.  Newton's  equations  for  m^  are 

Vi  ’  F  -  V  Fio,in6o  (18) 

Vi  ”  -Fiocoaeo  (19) 

In  differentiating  the  constraints  (13)  and 
(14),  Xq  and  zQ  are  held  constant.  The 

equation  for  6g  Is  derived  In  a  similar 
fashion  to  Case  S: 

9q  -  FcosSp/mjip  -  gcosSp/^-p  (20) 

Since  Xg  and  Zg  are  fixed,  (x^.z^)  could  be 

found  directly  from  the  algebraic  constraints 
once  (20)  was  solved.  However,  differential 
expressions  analogous  to  (16)  and  (17)  are 
more  useful  for  guidance  purposes: 

*1  “  ('VO2  +  8sl“eo)c08eo  * 

(21) 

Z1  “  <-40®02  +  8*ln60)slne0  -  g-Fcos20g/m1 


As  expected,  (20)-(22)  do  not  depend  on  mg, 
because  mQ  doesn’t  move  in  Case  F. 

Feedback  law:  Only  the  most  simple  form  of 
feedback  control  strategy  Is  described  here, 
and  It  Is  shown  that  feedback  from  only  6„ 

and  6g,  as  Illustrated  by  the  solid  feedback 

line  of  Figure  3,  Is  sufficient  to  provide 
the  features  of  useful  locomotion  described 
above.  The  discontinuous  feedback  law  Is 
most  readily  Illustrated  on  the  phase-plane 
plot  of  va.  6g  of  Figure  4. 

The  feedback  law  is: 

Whenever  (8g(t) , 8g(t))  in  Regions  A,E  or  F 
take  F(t)  »  0 

Whenever  (8g(t) , 8Q(t))  in  Regions  B,C  or  D 
take  F(t)  •  (mg+m^g 

For  any  Initial  condition  Inside  the  shaded 
area  except  the  point  (x/2,0)4,  the  motion 
of  the  system  will  eventually  settle  Into  a 
periodic  motion.  Initial  conditions  outside 
Che  shaded  regions  cannot  be  corrected  by  this 
feedback  law.  Disturbances  such  as  variation 
In  surface  height,  friction,  etc.,  result  In 
perturbations  to  the  trajectory,  which  are 
stable  if  the  system  resulns  Inside  the  shaded 
region.  Thus,  one  goal  of  accommodating  small 


Certain  additional  constraints  and  assump¬ 
tions,  which  may  slightly  decrease  the  size  of 
this  area,  have  been  intentionally  Ignored  In 
this  simplified  analysis. 


obstacles  has  been  sec.  A  second  goal,  of 
varying  the  speed  of  locomotion,  can  be  met 

by  varying  9  parametrically.  The  doe  per 
ala 

cycle  Is  roughly  related  to  the  area  enclosed 
by  the  periodic  trajectory,  while  the  horiz¬ 
ontal  distance  la  approximately  iQ(  ®max~  ®min^ ’ 

the  ratio  of  distance  to  time  Is  an  approx¬ 
imate  measure  of  average  forward  velocity. 

The  range  of  achievable  velocities  with  this 
locomotion  strategy  is  rather  small,  even 
though  che  corresponding  range  of  step  sizes 
(becween  0  and  2&q)  is  rather  large.  The 

margin  of  stability  of  the  larger  step  sizes 
Is  considerably  decreased,  however. 

The  continued  forward  motion  of  m^  does  not 

violate  conservation  of  momentum;  the  initial 
forward  momentum  Is  conserved  during  motion 
S,  but  during  motion  F,  it  is  augmented  by 
momentum  exchange,  which  occurs  due  to  the 
constraint  that  m^  remain  fixed  on  the 

surface.  Thus,  the  energy  expended  in  lift¬ 
ing  during  motion  S  can  in  fact  be  converted 
into  forward  acceleration  during  motion  F, 
and  the  forward  motion  will  not  die  out  (e.g. , 
due  to  friction  effects).  No  laws  of  physics 
are  violated  by  this  strategy. 


CONCLUSIONS 

The  examples,  drawn  from  two  different  areas 
of  robotics,  Illustrate  that  discontinuous 
feedback  laws  are  readily  devised  for  a 
variety  of  applications.  In  both  examples , 
the  feedback  law  could  be  viewed  as  a  finite 
set  of  mutually  exclusive  continuous-control 
subtaska.  In  the  first  example,  two  different 
linear  control  laws  were  used,  while  In  the 
second  example,  two  different  constant  values 
of  control  were  used.  Furthermore,  the  tran¬ 
sitions  between  tasks  were  closely  tied  to 
events  In  the  (full)  state  space  which  were 
readily  detectable,  e.g.  Interception  and 
rendezvous  in  the  first  example,  and  contact 
with  the  surfece  z“0  In  the  second.  These 
exanples  Illustrate  that  a  generalization  of 
the  methods  employed  by  Young  (1978)  may  be 
useful  In  future  robotics  applications.  A 
set  of  control  values  or  continuous-control 
feedback  lavs  sufficiently  rich  to  control 
the  motion  of  the  system  In  each  of  Its  known 
or  desired  states  la  chosen.  The  trajector¬ 
ies  of  the  system  under  these  forms  of  feed¬ 
back  are  computed.  The  switching  loci  between 
the  control  lews  are  then  taken  along  the  loci 
of  intersection  of  these  trajectories,  or 
along  a  physical  constraint  locus  of  tha 
system  motion.  In  such  a  way  that  tha  desired 
combination  of  movements  Is  obtained.  This 
has  the  effect  of  assuring  a  wall-defined  mods 
of  sliding  along  the  discontinuities  of  the 
closed-loop  system;  otherwise  the  nature  of 
sliding  might  change  markedly  and  unpredict- 
ably  within  a  discontinuity  surface  due  to 
trigonometric-type  nonlinearities  of  the 
equations  of  motloa. 


control  strategies  and  the  choice  of  switch¬ 
ing  loci  defined  by  Intersections  of  natural 
motions  of  the  system  under  these  candidate 
control  lava  appear  to  be  primary  requirements 
for  a  practical  design  theory  of  discontinu¬ 
ous  control  for  robotic  systems.  Presently, 
the  greatest  difficulties  In  the  development 
of  such  a  theory  are  the  relationship  of 
linguistically-described  goals  to  feedback 
law  selection,  the  lack  of  analytic  methods 
for  characterizing  controlled  motions  of  the 
system,  and  the  Inherent  difficulties  of 
stability  analysis  for  discontinuous  systems 
(Johnson,  1980) . 
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The  selection  of  e  finite  number  of  candidate 


Appendix  G 

Essentially  Continuous  Functional  Real  Coders 

1.  Let  F^,,  T  >  0  be  the  set  of  all  piecewise  uniformly  continuous  maps, 

with  a  finite  number  of  pieces  from  [0,T)  -►  R. 

For  feF_  geFT  we  define  an  operation  *  as  follows 
1  2 

g*f(x)  =  j  f(x)  if  xeCO.T^ 

\  gfx-Tj)  if  xetT1,T1+T2) 


It  is  clear  that  g*f  is  in  F  _  and  thus  F  =  U  F  is  closed  under  *„ 

1  2  T>0 

Let  $  :  F  +  R  be  a  given  map.  We  call  $  a  functional  real  coder.  In 

the  sequel  we  examine  certain  properties  of  such  coders. 

Let  use  define  the  relation  «  on  F  by 

$ 

feFT  “rf,  geFT 
T1  $  T2 

V  heFT 

3 

$(h*f)  =  $(h*g) 

Clearly  $  is  a  right-congruence  relation.  We  say  that  $  is  unitary  if 

F/fcv  has  but  one  class:  otherwise  we  call  $  finitary,  if  as  has  finite 
v  $ 

index,  or  non-finitary  if  it  does  not.  We  focus  on  unitary  coders  below. 

2.  Characterizing  Unitary  Coders 

Suppose  $  is  unitary.  We  would  like  to  see  if  we  can  find  a  simple 
characterization  of  $.  We  first  begin  with  an  elementary  but,  nonetheless, 
important  theorem. 


4 


Theorem:  If  fsFT  then  lim  f(t)  is  defined.  We  call  this  value  f(T). 

tvr 

Proof :  A  uniformly  continuous  map  on  an  interval  of  the  form  [a, B)  has  a 
uniformly  continuous  extension  to  [a, f3] .  Since  f  has  only  finitely  many 

A  A 

pieces  3  T  <  T  such  that  f  is  uniformly  continuous  on  [T,T] .  The  result 
follows.  QED 

3.  We  next  define  a  concept  of  fundamental  importance  for  coders — essential 
continuity. 

Definition:  $  is  essentially  continuous  (e.c.)  if  the  following  condition 

is  true:  v  e  >  0,J<S  >  0  s.t.  v  feFT  qeFT  ,  T1  <  T.,  if 

(1)  |f(x)-g(x)|  <6  for  all  xejO.Tp 

(2)  Igto-gCT^I  <<5  for  all  xetT^Tp 
and  (3)  |T2-T1|  <_  5 

then  |*(f)-*(g) |  <  e  a 

Let  us  restrict  our  attention  to  essentially  continuous  maps  4>.  Suppose, 
now,  that  $  is  unitary.  Let  feF^  be  arbitrary.  We  would  like  to  argue 

A 

that  <f(f)  is  completely  determined  by  f(T).  Specifically  _if  geF*,  T  ^  T 

A 

and  g(T)  =  f(T)  we  would  like  to  prove  that  <E>(f)  =  $(g).  How? 

Let  e  >  0  be  arbitrary.  By  the  uniform  continuity  (piecewise)  of  f, 

/s 

extended  to  [0,T]  and  g,  extended  to  [0,T]  we  argue  as  follows.  Let  5 
be  the  5  associated  with  e  by  virture  of  the  essential  continuity  of  $. 

3  p1  >  0  s.t.  for  all  xe[T-p  ,T),  jf(x)-f(T)|  <6/2.  Similarly  J  o2  >  0 

A  A  A  p 

s.t.  for  all  xe[T-o2,T),  jg(x)-g(T)|  <_  j.  Let  p  =  min  ( p^ , p£) •  Let 


us  define  another  map  hef^,  as  follows 

h(x)  =  (  f(x)  if  xe[0,T-p) 

(  gCT-T+x)  if  xe[T-p,T) 

Note  that  h  is  well-defined  and  is  in  f^.. 

Note  that 

(1)  For  xe[T-p,T) ,  |h(x)-f(x)|  <  6 

(£f :  |h(x)-f(x)|  <  |h(x)-g(T)| 

+  |g(T)-f(T)|  +  jf (x)-f (T) | .  With  g(T)  =  f(T),  we  have 
|h(x)-f(x) |  <  |h(x)-g(T) |  +  | f (x) -f (T) | 

A  A  A 

Now  let  y  =  T-T+x.  Note  that  ye[T-p,7)  and  that  h(x)  =  g(y)„  So 
jh(x)-f(x) j  <  |g(y)-g(T) |  +  |f (x)-f (T) j 
As  p  _<  pj  and  p  £  p2  it  follows  that 

|h(x)-f(x)|  <5/2  +5/2=5  QED) 

(2)  By  the  essentially  continuous  nature  of  $,  then 
|*(h)  -  *(f)|  <e 

(3)  Define  qeF  bv 

P 

A 

q(z)  =  g(T-p+  z) 

Note  that  if  we  write  f  as  the  restriction  of  f  to  [0,T-p)  and  g 

A 

as  the  restriction  of  g  to  [0,T-  )  then 
h  =  q  *  f 

g  =  q  *  g 


(Pf :  First  for  h.  If  xe[0,T-p)  q  *  f(x)  =  f(x)  =  f(x)  =  h(x). 


If  xe[T-p,T)  then  q*f(x)  =  q(x-(T-p)  =  g(T-T+x)  =  h(x).  Similarly 
for  q.  If  xe[0,T-p)  then  q*q(x)  =  q(x)  =  q(x).  If  X£[T-p,T)  then 
q*q(x)  =  q(x-(T-p))  =  g(x).  QED) 

(4)  As  $  is  initary,  f  =  <Jj  q.  So  3>(h)  =  $(g). 

(5)  Thus  by  2  ,  |*(g)-4(f) |  <  e 

As  e  is  arbitrary,  4>(g)  =  $(f).  We  summarize  this  by 

A 

Theorem :  If  $  is  unitary  and  essentially  continuous  and  feF^.,  g£F~,  T  ^  T, 

A 

with  f (T)  =  g(T),  then 
♦  (f)  =  *(g) 

Corollary:  Under  the  above  assumption  3  9:R  ■+  R  s.t.  V  feFT,  $(f)  *  9(f(T)). 

Proof :  Clear,  <l>  only  depends  upon  the  value  of  f  (T) .  QED 

Note  how,  with  the  condition  of  essential  continuity  we  have  generalized 
the  "sequence"  coders  earlier  studied. 

4.  For  this  reason  we  may  view  a  unitary  $  (e.c.)  as  memoryless.  We 

seek  a  unitary  <5>,  non  essentially  continuous,  that  is  not  memoryless 
to  show  the  necessity  of  essential  continuity  in  the  above  proof. 

Let  ACF  be  defined  by:  fEF^  is  in  A  iff  3  6  >  0,  5  £  T,  such  that  f(x)  =0 
for  Vex  [T-5,T). 

Define  ♦  by  $(f)  *  <  1  if  f£A 
|  0  if  f£A 

We  claim  that  ♦  is  unitary  and  not  essentially  continuous.  Clearly 
«  9:  R  -*■  R  s.t.  V  f£FT  *(f)  =  0(f(T)). 


Proof  of  Claim: 


/. 


1.  $  is  unitary:  Let  fgF  ,  gef  be  given,  along  with  hef„  .  If  h&A 

1  2  ‘3 

then  h*f  is  in  A  and,  conversely.  Similarly  for  h*g.  Thus 

If  heA,  <Kh*f)  =  <f{h*g)  =  1 

hj£A.  $(h*f)  =  $(h*g)  =  0 

So  <t(h*f)  =  <f(h*g)  and  f  ~  g.  Since  f  and  g  were  arbitrary,  $>  is 
unitary. 

2.  <t  is  not  essentially  continuous:  Let  feF,j,  be  defined  by  f(x)  =  0 

V  xefO,T).  Then  feA  and  $(f)  =  1.  Let  g^e  f^  be,  for  example,  defined 
by 

=  (  (l/k)x  xe[0,T/2) 

| (- l/k)x  +  T/k  xe[T/2,T) 


Note  that  <f(gk)  =  1  V  k  =  1,2,3,... 

Also  note  that,  for  any  5  >  0  3N  s.t.  for  k  ^  N,  |gk(x)  -  f(x)|  <5 

T 

V  xe[0,T).  (Take  N  s.t.  ^  {  or  N  2lT/26).  This  contradicts  the 

essential  continuity  of  $  for  if  e  <  1,  then  no  matter  how  small  a 
value  of  6  is  chosen  there  is  a  gk  obeying  |gk(x)-f(x)|  <6  V  xe[0,T) 
but  j  4> (Sk)  -  |  =  1  £  £. 


) 


So  the  condition  of  essential  continuity  is  a  necessary  one  in  the 
Theorem.  QED 

(Note  that  if  the  mav  $  is  such  that  $(f)  =  9(f(T))  for  a  fixed  0, 
V  fe[0,T),  then  $  is  both  unitary  and  e.c. ) 


